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FOREWORD 



' Most readers of the literature ,on educational account- 
ability are immediately -conscious of the varied ways in which . ^ 
the accountabilitv concept has been and is being interpreted. 
While there may be' som6 strength in the flexibility provided, 
by a variety o&^ interpretations , the lack °of general-consensus , 
concerning 'the meaning of educational accountability has re- 
sulted in confusion and* resista nee within the educational ranks. 
A clear " translation" " of accountability concepts now is essen- 
tial to-a-proper understanding of the process and to its 
successful implentation. ' Lesley H. Browder, Jr. has provided 
^such a translation in this highly useful monograph^ Who's 
Afraid of Educational Accountability? 7i Representdtive Review 
Q,f the Literature . 

Although Dr. Brov/der notes that this .is not a definitive 
analysis of all 4,000-plus items published to date in the area 
of educational accountabi Uty , he has accomplished a thorough 
exploration of many important documents both supportive ana 
• critical of the concept. Browder couples his summary of 
accountability definitions with a recap of the variou? outside 
pressures -which have caused this educational phenomenon to 
gain mo.p.entum. While providing a parallel between performance 
by objectives in the noneducatiorial wofld and the realm of , 
education* he also interprets various applications of account- 
ability, which should aid the teachei;, school administrator, 
parent, and others to gain a clearer understanding of the 
P'lrposa of educational accoun cability as well as its many 
techniques. . ■ ' , 

This monograph should receive broad readership in light 
of the fact that all indications imply the American people are 
more interested thali ever in the vitality of -public education. 
Basically, the public (parents, taxpayers, and others) wants 
to see a relationship between the money they put into education 
- . .the -expertise the educators add... and the outcome m terms 
of human -learning results. Proponents of accountability believe / 
this is a reasonable request. . ^ ^ 

» 

As Or Browder 's monograph reveals, there has been a 
serious search for better' ways to evaluate educational perforra- 
"ance. Findings based on extensive research are reported in^ the 
literature. It now remains for the public,^ government, and the 
education profession to join forces in demanding and seeking 
•oven better measures of performance and better -reporting procedures. 
The continuing— even accelerating interest in educational account- 
ability across the nation is a positive indication that a DOint 
effort in accountability is rapidly becoming a reality. 

Arthur R. Olson, Director 
Cooperative Accouritability Project 
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CHAPTER I 



INTRODUCTION: THE. NATURE, RANGE AND SfOPE OF THE REVIEW 



Ift the five-year period since 1969/ the "accountability 
movement" (as some have labeled it) has generated over.4,0M 
books and articles, legislation and/or resolutions in 33 s^tes^ 
and has caused "considerable concern in education's ranks. 
(Hawthprne 1973; Kemp 1974).. This report proposes to do two 
things: (1) -to review what appears to the author as represen- 
tative highlights of this educational accountability literature 
and (2) to provide some perspective of where the movement is 
he^aded . . . * • 

Naturally there are some obvious risks associated with 
such an effort. For one thing, the author has not' read .or 
even seen all 4,000-plus books and articles (although he prob- 
ably is familiar with half the extant work) . At the same time 
and depending upon what genre of literature one lumps under 
the accountability banner', it is conceivable for .the literature 
of the field to have expanded well beyond one-mafi mastery at 
this point. 

This mushrooming of printed information stands in sharp' 
contrast to 1970-71 when .the author was completing his first 
effort (Brov^der 1971) . At. that time it was possible to contain 
nearly all the written materials of the accountability ijiovement 
on, the family dining room table,- to be able to call by phone- 
the leading contributors, to find out rapidly who was doing 
what, and to track down what a relatively small group thought 
was important. " , ' 

*^ 

Today this ability'has evaporated. An information bliz- 
zard is in "progress. The chance of oversight is excellent. 
Even James Kemp's (1974) excellent 157-page bibliography of 
the literature touches on only "a- portion of the existing works 
and omits many others (including .this author's). If' Kemp 
had decided to add, for example, "systems theory" and "manage- 
ment technology" as. related portions of his accountability 
bibliography (perhaps in place of "functional li teracy/illit- 
eracy"), the bibliography would -have had to be -lengthened by 
many hundreds of pages. In short, a literature both so vast 
and changeable by inclusion or exclusion of areas believed or 



not believed related to accountability is difficult*' to- review*. 
One is likely to miss some major works (particularly as. their 
authors view* them) and/or to disregard works that, in the 
judgment of others, clearly should have been acknowledged. 
The risk here is chastis.ement .of the reviewer for not being 
"with it.'*^ . • t ■ ^ 

On the, other hand, it might not be unfair' to say that 
some 95 percent of the literature contributes very little new 
information, ,ins:^ghts, perceptions, or ^conceptual develop-^ 
ment.^ "»Hard^ta" research is even rarer. Citing Fred- 
Niedermeyer -and Stephen Klein's 1972 research as a "first," \ 
Stanley Elam (1974) cbmplains (vjg.th the' ekception of small,' 
subjective "I-know-a-case" investigations) that, until the 
Ernest House, Wendell .Rivers , and Daniel Stuff lebeam (1974) 
study of Michigan's statewide system of accountability, there 
has been a "research hiatus" on the subject. Thus, while 
there is a iong "how-to-do~it" literature and even longer lit- 
erature th'at;^ might 'be labelled "the rhetoric of accountability, 
there also are gaps — notably in the areas of actual develop- 
ment of the concept and. research evidence of its effectiveness. 
This observation is a way of saying that there has h?een more 
literary chest-beating about accountability than hard" think- 
ing^ and more suggestions of what needs to be done and how 
than doingvand finding out\what difference it made. 

The work* presented in this monograph is the author's own 
attempt to piece together a representative , review of the lit- 
erature; this attempt admittedly overlook^ many works, does 
not always, offer "the beat"'works, (simply representative ones), 
and is patterned after the author's own observations of what 
is important and what is not — plainly a matter of individual 
judgment. The plan for this literature review is to offer: ^ 
(1) an overview of accountability, 1974; (2) a review of de- 
finitions and concepts; (3) a look at expressions of the 
accountability concept applied to public education; (4) an 
overview of accountability models;, and (5) some continuing 
issues and concluding remarks. A list 'of references (not to 
be regarded as a definitive bibliography) is offered at the 
back of the monograph. / 
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CHAPTER II • • " , 

AN' OVERVIEW OF AQCOUNTABILXTY , 1974 ^ » ' 

Whatsis st?:iking about the state of accountability in ^ 
1974? From a literature nearly fivevy^ars old, the following 
three Impressions emerge: ^ ' * ^ . 

** * . ' 

''. vl. ^ There are no commonly agreed-upon definitions^ 
^- The basic term itself, "accountability," has 
, clef ignitions ranging f rom^ the relatively loose 
idea of simply holding someone ''responsible for 
doing .^something to highly sf)eci-f ied technical - 
definitions.. There is no lack of -definitions . 
There is a lack of agreement on which ones to 
use. This leads to the problem of distinguishing 
when ,the term is being used appropriately and 
when it. is not. In short, there is presehtLy ^ 
a sea of def iiiiitions (to be examined more closely . 
below) . This definitional sur^it need .not be 
considered a- serious problem in itself, but 
rather a signal that the term is ready fdr con- 
ceptual refinement. 

"2. As a concept-, accountability needs refinement. 
It should be clear to anyone attempting to 
develx>p accountability concep^tuaraiy that it is ' 
a term capable ^f being refined. It can depict 

♦* ^ a range of situations, degrees, and levels. i ! 

Unlike the state of pregnancy , (eith'er you are or 
you are not) , there are ranges of meanilng between 
"general accountability" and "specific accouat-^^, 
ability," between "institutional accountability" 
and -"tecHnological accountability," between 
"managerial accountability" anji "educationa-1 
accoi^tability^, " etc. The failure .to produce a , 
•recognized, basic/ multi-dimensional framework 
that.. sorts, out, differentiates, and comprehen- . ^ 
siveLy unifies levels,- degrees, and forms of 
' accountability contributes to the confusion. 
^' Seemingly the initial roots of the idea have 
pushed" it to another stage in its development. 

■ -■ ^'^ 9 ■ ,. 



It Awdxild appear that a stronger root/ system is 
necessary if" the substance*'of the i-dea is* to 
mature further.^ Leon Lessinger (19'70a, 1970b, 
1970c), the "father" and ^original popularizer 
of 'Educational aqcount^bility f " introduced the 
noti6n of holding^ educato^^s*" accountable for- " ' 
what students Lea'r'n as a prapfiatic practitioner 
who recognized the *need to^ focus both '^^ublic and 
prof es^ional -attention oh * what our schools pro- 
duce in terms of eduqational results. At the 
'time, 'theoret^ical- nice^iefe wet'e^nx^t Jje^sing^r '.s . 
int^'r,est. . \ ' ' * ^ ^ * " ^''v 

*If a comprehensive frsutiQwork cannot be developed 
or agreed upon as a common point of reference, 
the risk is presented that accountability^ will 
conceptually waste away as a passing fad or ^^11 
assume,,a*new guis'e and grow f rom ^that point. -.^ At 
the ssone time, research ^efforts ''are likely to re- 

/main scattered, piecemeal , -and unsystematic; 0|ie. ^ 
h^ to^ inquire about the form o'f accountability 
being applied, the nature of the differences it* 
is expected to make in_f:^e situation, as well 
the conditions under whit;h it was applied. A • 
conceptual taxonomy that can be tested through 
various forms of application and in a variety of 
situations is^^ sorely needed^ * / . 

Accoxintahilxty^ has become politicized . The process 
of altering relationships from general to more 
specified responsibilities for accountability 
purposes carries political implications. For 
organized interest groups /*the politics of accounts- 
ability "(particularly where emphasis is placed 
on tightly drawn ^sponsibilities) guarantee as 
much effort will be expended attacking th'e con- 
cept as promoting it on grounds other than dis- 
passionate reason. 

For example, the present state of education offers 
no definition for malpractice. Yet as the ex- *V 
pectatiqns , methods , -and procedures of educational 
practice become more highly stipulated (especially 
by state law) , malpractice definitions (particu- 
larly those regarding forms of educational negli- 
•gence)..are likely to* emerge. Organized efforts 
can be ^pected, like those of the New Jersey 
Educatio/i Association, to block .statewide testing 
program^ because-r-to quote teacher' spokesmen — 
"the results of a testing prog.ram will eventually 
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onable^^Te authority tc.^^rcward thofee who do 
his' bidding and punish those who do not con- 

' * form" (Rein 1974) • Politically, accountabil- . 

it-y is perceived, by. many^JLndividuals as something 
^- 'aesirable when done* unto others and undesi^rable 

% when focused"^ upon themselves, 

• • 

.Such ^olitica'liza^tion of accountabilit^y has meant 

• there is a built-in readiness to invalidate 
the Idea of accountability-by-results , when -one 
of its. forms seemingly malfunctions in practi<:e 
•{e.g. /''external performance contracting)* It 

* ''must^e insisted upon that the concept ;of ac- 

countability be separated; as a conc€Spt, from 
^ the means used" to -express it, ^To^date more work/ 
has "gone into developing models and applications 
of a t)artialdy formed idea than has been in^/ested 
in developing an understandable framework for 
i the idea. We seem ^ to be in a .po*si-«.on somewhat 

Similar to that^of * Thomas Edison, 'Edison's be- 
lief in -^he' concept of electric -light , however, 
was sufficiently strong to carry him through - 
hundreds bf applications before he developed 
both 'his concept and applications to a point., 
that worked satisfactorily- Many people in ed- 
.ucation' have' neither Edison '-s . faith nor patience, 
anS they tend to re ject. concj^pts pragmatically 
when concept applications cause problems or ad- 
versely influence group interests* Thrust into 
a political atinosphere where, characteristic be- 
havior is to pf'ess for ins^tant, simple solQtions 
' to. problems shallowly re.cjarded, educational forms 
of accountability can expect a difficult time. 
Almost invariably,, educational pL'oblems are com- 
plex, time-consuming, and require a kind o-f so- 
phistication, patience, and expertise^hat .does 
not mix well with political wr/ngling- On the 
^ other hantJ, ^it.has largely been political pres- 
sure 02?.erted at sfeate and federal levels that 
has made acct)untability aignif^cMi't in education, 
Without*the continuance of sudh "oi^tside^* pollt-^ 
ical pressures^, it is doubtful that accoun^abil-^ ' 
ity as a'jT^ovement in 'education will Ja$t long / • 

against the "inside" political pressTure^ of o:^-- - 
ganized teacher groups. ' 

In addition to these three interrelated Veasons^--the lack 
agreement on b6th definitions and the dii?ection of concept 
inement, as well" as the problcrn. of pplifericali zata on--t;here 
other- issues and questions in the literature ( call it 
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"noise" in the ^system) that detract from efforts^-to develop 
acbountabirity • Some individuals question the value of ed-^^ 
ucational ^accountability on philosophical an^ ^humanitarian" , 
grounds (Leight 1973) (Hills 1974).^ There remain questions^ 
not onty about the' desirability but 'the technological ability 
of the educational field to deliver some forms of account- 
ability, particularly where testing is used (Klein 1971) 
(House, Rivers^ and Stuff lebeam 1974). - . * 

^ Without attempting to make this* paper more elaborate at 
this point, it seems fair to/conclude from the ^ literature that 
the History of education's sharpened^ forms of accountability 
is still' too brief to make a judgment that the' newapplica- 
tions of the concept (1) are clearly superior to the old ap- 
plica-tionsT (2) make significant dif f erencfes ' in terms of 
results achieved;. (3) create truly more accountable relation- 
ships between parties;. and (4) should serve as 'the basrs^of 
all futu^re development in the applied art/science of public 
education. It is simply too early in the .doncep^t's develop- 
ment In education^^to a^ccept or reject such conclusions. ^ The 
"promise still remains/ but its realization is not likely to 
be quick, simple, painless, unsophisticated, or effortless 
the ^common requisites of politically acceptable change in 
ed^^ipation. - . ^ , ' - ' . 
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.CHAPTER III 



r REVIEW OF DEFINITIONS AND CONCEPTS 



In applied sciences like education, there gene 
believed to be a relationship between theory and p: " v". 
While it is not always clear that good practice is o.^^cd 
upon good theory (or the Ireverse) , the value of , both seems 
enhanced when their goodness coincides. Probably the heart ' ^ 
of any theory -is the nature of the definitions and concepts 
that give it meaning. In the case ofXaccountability , an old 
and simple idea was given an emphasis ,\dimension , and ap- ■ 
plications new to 20th-century American^ education. If this 
newer interpretation of accountability ^ has a relationship 
with .theory, its linkage is located in its definitions and 
concepts. \ , 

What is meant by accountability? he indicated above, 
a cIear-cut^def inition is complicated. Tor example, the term 
appears ia'-the literature frequently in three senses. First, 
its uncrit^ical usage is synonymous with responsibility. A 
second usage' is more critical, suggesting an obligation to 
explain or account for the disposition of tasks entrusted to 
an individual. The third , sense appears in the form of a par- 
tially defined Concept peculiar to education — educational 
ac^countability. This^ usage conveys the notion that the 
schools and the educators who^ operate them be "held to ac- 
count" (i.e., held both responsible and answerable) for what 
they produce or fail to produce as "ediicational outcomes" 
(i.e..., for what students, learn). 

Before education borrowed the term and inflated it with 
its own meanings, accountability expressed a relationship 
between the, occupants of roles who control institutions, the 
"holders of power" — stewards — and those who possess the for- 
mal power to displace them — reviewers (Vickers 1965). The 
scope of this form, of accountability includes everything 
those who hold formal powers of dismissal (the reviewers) ^ 
find necessary in making their major decision. This decision 
is whether to continue ox .to withdraw confidence in those 
office holders he?.d to account (the stewards) . From this 
role relationship^^ a simple de^finition of accountability (as 
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it is traditionally understood) follows: 



The requirement on the occupant of a role, by 
those who authorize that role, to answer for 
the results of work expected from him in the 
ro'^e' (Newman and Rowbottom 19o8Jl,. 

But few reii\ain simple. Ciange, that tenacious 

force of our t has been busy reshaping this simple idea. 

Brought into the definition ndw Is the notion of operation- 
ally specifying by degree what tasks are to be accomplished 
by the steward — the person entrusted to execute the tasks — ^ 
prior to his undertaking them. A more extended version of 
this shift in the original concept might be rendered as follows 

1. Accountability is a process that occurs^ in a 

relationship between those entrusted with the . 
accomplishment of sjpeci£ic tasks, (stewards), 
and these having power of review (reviewers) . 

'2. The heart of the process is for the party ^ 

"standing to account," the steward, to explain 
as rationally as possible the results of efforts 
to achieve the specified tasks of objectives 
of his stewardship . 

#■ 

3. Of major concern to the parties reviewing the 
stewardship of the tasks performed is the 
matching of performance and attainment levels 
against their expectations as expressed in the 
task specifications , and de4sfermining their 

level of confidenc(> in the steward and his ef- ^ 
forts.- 

^ 

4. Of major concern to the steward standing to 
account is his ability to accomplish the spe- 
cified tasks as well as his ability to explain 
attainment levels in a manner that maintains 
or builds the reviewers*'' -confidence in hid 
stewardship. 

The italicized words and phrases are intended to rep- 
resent , in part, the newer modifications as superimposed 
on the original^ accountability concept. The italicized 
words represent accountability's newly emerging .pattern' " 
(Browder 1971) . 

Lesley Browder (1973, pp. 6-9) ^offers a simple con- 
trast between the more common form of the accountability 
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process and its emerging form: 

COMMON FORM, Woodcutter Ames agrees to chop wood for 
Mr. Cotton for a "day's hii;e." Mr. Cotton assigns Ames his 
tasks, tells him what he wants done, and occasionally checks 
on Ames to see that the tasks are being done and that a 
"fair day's work" effort is being made. Ames chops wood. 
Mr. Cotton pays Ames for his day's work. Ames is largely ac- 
countable only for his day's work and for following Mr. Cotton's 
instructions (I did what you told me to do) . Mr. Cotton 
judgesxfor himself whether the results represent a "fair day's 
work"* as well as what he thinks he told Ames to do^. 

EMERGING FORM. Woodcutter Brown also agrees to chop wood 
for Mr. Cotton. 'However, before Brown chops any wood, he and 
Mr. Cotton agree in writing how muqh wood is to be chopped, 
which ^ield is to be cleared, approximately when the task is 
to be completed, and under what conditions the cleared field 
and chopped wood are to be found at the conclusion of the tasks. 
Different payment amounts are established for each of the 
tasks to be completed. Because in this case'^time is impor- 
tant to Mr. Cotton, a bonus payment is included if 3rown' can 
complete the tasks ahead of schedule. By the same token. 
Brown also agrees to accept a reduced payment (a "discount ) 
if he must work beyond the agreed-upon time completion mar- 
gins. Woodcutter Brown does his work without Mr. Cotton s 
supervision. When the tasks are completed. Brown renders an 
accounting of the results expected in the written agreement 
and those he actually achieved. Mr. 'Cotton checks his steward s 
account and p^ys accorr'ing to their agreement for the results 
actually acheived. 

Thus several things happen in the emerging form of ac-~ 
countability that are less common by degree ,ih tfie more 
usual work arrangements: , . . 

1*. There" is first a carefully written agree- 
ment about what is expected to result from 
the steward's efforts, stated in terms of 
performance objectives with measurable or ^ 
evaluative criteria. It may or may not state 
what rewards* or penalties will be awarded 
by the reviewe'r for the results achieved 
or not achieved. 

2. . Because ,the description of what performance 
ds expected is so specifically written,, the 
steward's obligations are more pointed. He 
knows v/hat is expected and what is not ex- 
pecfce'd. In accounting for his efforts, it 
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is less easy to slough off specifically 
stated tasks than the more normal, loosely 
stated ones. For example, in the more 
tightly stipulated task assignment/ "to 
remove all the trees., including their lirunks, 
.fiom the designated field," as opposed to 
the* looser expectation, "to give a fair day's 
work," there is little doubt what is ex- 
pected of the steward. He accomplishes the" 
task or he does not. If he does not, either 
he already knows 'the consequence (if rewards 
' and penalties are stipulated in the agree- 
ment) or he is expected to provide a convinc- 
ing explanation for his failure to complete 
the task if he desires to retain* his reviewer's 
confidence in his stewardship. But what is a 
"fair day's work," and is the reviewer more 
concerned about the possibility * of being cheat- 
ed by his steward's interpretation of it than 
in getting th.v tasks accomplished? In the 
emerging form of accountability, the focus is 
plainly on getting the tasks accomplished by 
the steward or finding out why said tasks were 
not done (with searching for alternative ways 
as an outgrowth of unacceptable performance) 

3, Similarly, the agreement also obligates the 
reviewer by preestablishing the criteria of ^ 
his expectations; (that. is, by saying specif- 
ically what differences he expects his steward's ^ 
efforts to make) . He cannot whimsically change 

his expectations in midsj|r;p4in,',add "surprise" 

responsibilities ("Ife won't take you a minute"), 

or otherwise escape his own responsibility to 

define what he expects to happen before -the 

steward begins the task. This- early detailing 

of expected results avoids later familiar com- \ 

ments from the reviewer such as: '"That's not 

what I want." "I thought' you meant to do..." 

"Why didn't you do this and that too?" "Vvho 

told yon to do that?" "I don't understand what 

you did do." "You didn' t* understand what I 

want." "But it*was my understanding that..." 

And so on.*^ 

4. Because the tasks are both carefully designated 
and contain measurable criteria for evaluating 
the performance results, it is less necessary 
for the reviewer to be concerned with close or 
direct supervision of the steward's work; tho 
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reviewer is concerned primarily with verifi- 
cation of the steward ' s .account of his work. 
if , * ^ 

5. By establishing in acivance the criteria for 
results and the" quality of these, results/ 'the 
reviewer's decision as to whether or not the 
steward's achievements are good enough or^ 
otherwise acceptable — the reviewer's level-of- 
confidence judgment — can be'made'^at a mor^^ 
informed level. At least a yardstick familiar 
to both parties has been established, and it 
can be used to measure whether the steward's 
task performance (or lack of performance) made 
a difference. At the same time, the steward 
knows that if he succeeds in achieving the task 
objectives, he can reasonably count on his re- 
viewer's continued -confidence ill his steward- 
ship. \ 

Applied to education, this shift toward increasing the 
degree of accountability by spelling out beforehand how per- 
formance is to be measured — that is, by predeterming ob- 
jectives with evaluative criteria — is similar. Teaching 
spe.ci^ic skills and concepts under stipulated conditions, en-^ 
surging that each "student experiences a year's learning growth 
(or .4"me designated growth) in terms of himself or herself 
as an individual, or ensuring that a faculty, as a team, 
accomplishes measurable objectives toward some larger goals 
(pljilosophical or otherwise), may all be ^part of the pre- 
determined expectations for educational achievement — the 
elements of objectives that move a^ school district closer to- 
ward realizing its educational goals. 

Because the emerging form of ^ accountability lends itself 
so readily to forms of contract negotiation, particularly in 
the public sector, it seems appropriate to use the phrase, 
negotiable accountability . In 1971 Browder defined negotiable 
accountability as: 

The requirement on the occupant^ of a role, as de- 
termined by a negotiated contract (defining as- , ^ 
signable, measurable units of responsibility to 
be fulfilled under certain conditions .and within , / 

certain constraints), to answer for the specified 
results of work expected from him in the role in 
return for specified benefits accorded by results.^ 

Naturally other definitions of accountability abound (take 
your pick). To varying degrees, they reflect the shift toward 
the emerging form discussed above. For example, note the 
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( e parallel between Browder's ''negotiable accountability'' 
*»lkin's definition: 

Accountability^ is a negotiated relationship in 
'which the participants agree in advance to ac- 
cept specified rewards and costs on the basis 
of evaluation findings as to, the attainment of 
* specified ends (1972) . 

Alkin's negotiated agreement .between parti.es also en- 
visions the written contract as the most likely. vehicle for 
the newer form of accountability. It would specify: 

1. A set of co/.straints 

-> 

2* A -negotiated statement of what differences 

/ , are to be made within that constraining 

^ framework 

3^ The criteria for determining the outcomes ' . 

4. How the level-of-conf idence issue is to be 
handled in terms of rewards and costs (in- 
cluding payment and penalty schedules) 

Similarly, Lessinger (1970) also sees accountability as 
the pr.oduct of a sort of negotiation process: 

At its most basic level, it [accpuntability] 
means an agent, public or private, entering into 
a contractual agreement to perform a service 
will be answerable for performing according to 
agreed-upon terms, within "^an established time 
period, and with a stipulated use of resources 
and performance standards. 

» 

' The contract agreement form of negotiable accountability 
with its explicitly written stipulations for expected and ^ 
measurable performance outcomes, its framework of constraints 
and its schedules for according benefits and/or penalties by 
results, perhaps represents the most extreme form of the con- 
cept's transition. Somewhat less extreme in its implications 
is Lopez' (1970) definition: 

' Accountability refers to the process of ex- 
pecting each member of an organization to 
ansv/er to someone for doing specific things 
according to specific plans and against cer- 
tain timetables to accomplish tangible per- 
formance results. J^Q 
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Even less rigorous is Lieberman's (1970) assertion that . 
tlie purpose of accountability is fulfilled "when resources 
and efforts are related to res^ults in ways that are useful 
for policy making^ resource allocation, or compensation," 

^ Moving conceptually from expressing a role relationship 
into a system format, Henry Levin (1974) views accountability 
systems as a closed loop reflecting: 

- c 

••.a chain of responses to perceived needs or 
demands; an activity or set of activities that 
emerges to fill those demands; outcomes that 
result from those activities; and feedback on 
outcomes to the source of the demands*. The 
feedback may* generate new demands or a reg'en- 
eration of the old ones; in either case, the* 
previous set of activities may be modified or 
' remain intact; a' new or an altered set of ac- 
tivities may be modified or remain intact; ,a - 
new or an altered set of outcomes may be pro- 
duced;' and the loop is completed again with 
feedback to the source of demands, , (p. 375) 

. . Where the linkages are tight in the accountability system 
and information is generated and dispersed freely, 'the system 
flows continuously and dynamically. It is less responsive 
and/ hence JLess controlling, when 'these conditions are not mej:. 

Concerning the task of assigning or establishing levels 
of responsibility/ or the "who-is-accountable-to-whom-f or-what" 
issue, Alkin (1972) offers some useful concepts* Jle sees three 
levels of accountability systems: 

1, 'Goal accoxintahilit^ . School boards (state / 

and local) are ' accountable to the general 
public (through the election and/or 'appoint-, 
ment process) for everything they dO/ but • 
particularly ..for ensuring that the appropriate 
goals and objectives are being pursued by 
the state or locals schot>l^ district , through 
authorized programs.^ 

2. V^TogTBLm accountability . Responsibility for 
programs that translate goals into sets of 
specified' objectives rests generally with 
administrators and those persons involved 

in the seleq.tion, modification, and ^adoption 
of the programs/ and thereby the administrators 
make themselves accountable to the board. 




3, Outcome accountability . An instructional 
leader (usually a teacher) is accountable 
to' administration for specified pupil out- 
comes which are thought to^ be a function 
of teacher management of the instructional 
progi(^m. That is, a teacher manages an in- 
structional program which has certain product . 
capabilities; the challenge is to determine 
whether the teacher has managed the program • - 

in such a way as to achieve standards -or 
criteria that might be expected from the ' 
program. 

While the above brief description hardly does justice 
to Alkin's well-developed thesis, it points toward^ a rough 
approach to the apportioning of accountable responsibilities. 
At the point of applying this concept, the difficulty of this 
process of finely separating responsibilities is, as Lennon 
,(1971) has cited, enormous. *Both Barro (1970) and Dyer (1970) - 
indicate the great complexity of the data-gathering task and 
of the analytical methods used to assign responsibility to - 
contributing parties when the accountability concep^t is applied. 
Both Barro and Dyer, as well as Klein and Alkin (1972) , rely 
on the use of multiple ^regression analysis, a statistical 
procedure, to isolate outcome accountability as an applied 
concept. 

While the researchers worry , about the theoretically pure 
points of the responsibility^assi^nmeyit process/ .the practi- 
tioners manage to work 'out enough of the problems to permit 
action ^Alameda County School Department, 1972; San Juan 
Board of Cooperative Services, 1974). Solutions to concept 
application problems are as likely to be found in 'forms of 
negotiated accountability as^ they are in technological and • 
procedural breakthroughs like multiple regression analysis. 

What might be concluded from the literature's difinitions 
and concepts? Some reflection yields the following insights: 

1. Conceptually f the thrust pf accountability 
in education has its roots buried in con- 
trol theory. Accountabil ity may be viewed 
as a phenomenon of control theory. The 
field of education is a' relative newcomer - ; - 
in terms of modern 'usage of control theory ^ 
applied to the management of planning- 
dec ision-perf ormance-contrbl problems con- 
sidered as one comprehensive system. With 
the fields of engineering and mathematics 
setting the pace of theoretical development,* 
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research and conceptual refinement of forms 
of management control have been undertaken 
in such fields as accounting, economics, 
industrial psychology, computer science, 
systems .engineering, and only recently in 
education. Conceptually linking account- 
ability as an aspect of control theory moves 
• it into theoretically deeper and richer 
(for application)' ^'-waters. 

2.' A reciprocal relationship can be^expected ^ 
between the refinement of specific applica- 
tions of control theory in different fields 
(with educational accountability beting one 
of its newer forms in the educational field),' 
conceptual growth of basic control theory, 
and the emerg'ehce of neW applica^^ions from 
the further developed theory base. That is, 
while the peculiarities of each field will 
create operational nuances for that field's 
form of application, the field should be able 
to' contribute to the conceptual growth of 
control theory and draw from the fundamental 
theory fresh new forms of application for its 
' use. Thus have a case of multiple practices 
and applications in many fields feeding a 
conceptual base/ which, in turn,- produces., 
insights for fresH^ application in the various 
fields. ' / ' ' 

c 

If these assertions have merit, the implication is that 
the field of education should look at the conceptually richer 
domain of control theory, viewing forms' -of educational ac- 
countability as a manifestation of it, rather than attempt 
to reinvent the wheel in the sense of developing new vocab- 
ularies and jargon to express an existing theory. 

What are the grounds foi? making this linkage between ac- 
countability and jontrol theory? Perhaps this conceptual 
^linkage is best, seen *in related organization theory literature. 
For example^, organization theorist James Thompson (1967) 
claims uncertainty to be the fundamental problem of complex 
drganizations and coping with uncertainty the essence of the 
administrative process. This coping process characteristically 
is aimed at increasing certainty in an open environment that 
is forever producing uncertainties' both within and wi^thout the 
organization— a doncept Thompson labels (p. 9) the ''Simon-March- 
Cyert stream of study" (Simon, 1957a; March and Simon, 1958^; 
Cyart and March^ 19&3) . Accordingly Thompson conceives of 
complex organizations as "open ^ systems , hence indeterminate 

"l5 



and faced with uncertainty, but at the same time as subject 
to criteria of rationality and hence needing determinatenSss 
and certainty" (p. 10)/ 

This mixture' of permanent but variable uncertfainty and 
.the perejinial struggle of organizations to reduce it to tol- 
erable levels of certainty and predictable consequence opens 
the door of control theory% As Dorwin Cartwright maintains r 
"The view prevails that every organization has a basic objec- 
tiye, and to be viable it must have some control system to 
guarantee accomplisliment o| thi's objective" (Cartwright, 1965,^ 
p. 2) . In the sense of moving toward the elimination of un- ^ 
certainty or randomness ' and increasing certainty and predict- 
ability of accomplishment, ^control theory and accountability 
share the same concept. 

What makes control theory the parent concept and "account- 
ability its child is that control theotry covers both man and 
machine as a concept. It need not restrict itself to man 
alone (as '^accountability does) and the fuzziness of uncertainty 
randomness, or disorder 'that can only be reduced, but never 
eliminated, from organizat^ions which need to rely on authority 
structures, role relationships, arid/dr power and influence 
arrangements to motivate individulas. Simon's phrase, "bounded 
rationality" (l^'SJb) , seems apt in describing one of account- 
ability* s conceptual limitations. 

Control theory V however, is rationally unrestricted. Its 
only requirement is that of directing a set of variables to- ^ 
ward a preconceived objective. Norton Bedford (1974) explains: 

For control to exist there must be something, an 
activity or^ a process, to be controlled. But 
this is not" sufficient, for whether the something 
to be controlled is the actions of a person, 
machine, a group of resources, or any process, 
control cannot be applied unless the way in which 
the variable components of the process are to 
' . be directed has been determined. That is, an 
- objective or goal must be specified for the pro- 
cess, entity, or activity to indicate the way 
in which it is to be directed. Bftt given a* . . 
process an<J specified objectives, a control prob- 
lem exists (p. 508). 

Thus, in the theoretical rense, control may be defined as 
"the process of specifying preferred states of affairs and 
revising ongoing processes so as to move in the direction of 
these preferred states" (Etzioni, 1968, p. 45). 
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Confined to organizational structure, however, Amitai 
''Etzioni .(1965) qualifies control as "a distribution of means 
used by an organization" to elicit the performance it needs 
a-nd to check whether the quantities and qualities of such 
performance are in accord with organizational specifications" 
(p. 650) . Within this narrower dimension and as- a part of 
control theory ' s means of distributing and directing organi- 
zational activity lies accountability, a role relationship 
between people. As mentioned above, simply defined,^ accpunt- 
ability is "the requirement on the occupant of a role, by 
those who authorize that role, to answer for the results of 
work^ expected from him in the role" - (Newman ^d' Rowbottom, 
1968, p. 26) . . . 

There also is another dimension of control theory that 
seemingly has, awakened renewed attention in the educational 
field. Reflecting on the, nature of control, Bedford (1974) 
comments, "In the general sense that control is itself a. 
process that ensures that what-" 'ought • to be done is done, a 
sense of 'oughtness* underlies the control concept" (p. 509) .„v_ 
Echoes Frank Jennings (197'2) , "Now we pronounce account- 
^ ability f a firm protestant word, to label task's we^promise 
to do better than we have done before .. .Accountability , what- 
ever meaning- we infuse it with, refers essentially to moral 
behavior"' (p. 333). In a sense, it is* control theory's 
quality of "oughtness" and its drive toward insuring that what 
ought to be done is done^ that seemingly infuses the newer forms 
*of accountability with moral deteannination to drive out un- ^ 
certainty of^ accomplisfiment in education by altering the nature 
of its expectations. By simply operationally specifying by 
degree — "by degree" in a sense rangirV^g from heXng higj^ly 
specified abput^s^e educational tasks {e.g*, learning^ number 
-facts, the alphabet, etc.) to being less spfecified about 
other tasks (e.g., developing attitudes^ appreciations, etc.) — 
what tasks are to be accomplished by the steward — the person 
entrusted to execute the tasks — prior to his undertaking them,, 
a hew force (one consistent vvith control theory's drive toward 
eliminating uncertainty) is added to the term "accountability." 

^ How might this change in concept be applies? What does 
the literature tell us? 
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CHAPTER IV 

t 

A LOOK AT EXPRESSIONS OF THE ACCOUNTABILITY CONCEPT APPLIED 

TO PUBLIC EDUCATION " ^ 



Before examining the manner in v/hich the accountability 
concept is applied to specific practices in public education, 
it se.ems worthwhile to indicate the presence of three broad 
movements that appear to exist at the same point in time and 
lend applications of the accountability concept much of their 
thrust. Each of these movements has a literature of its Qv;n 
and tends to support and undergird various applications of 
accountability. In this regard, it i^s^^dif f icult to delineate 
when and where some pieces of the literature should be cll^ass- 
ified.^ In a sort of artificial serfse.^.then , the literature 
is bei^ig arbitrarily broken into two ^fections: (1) a litera- 
ture supporting the application^ of accopntaiDility concepts, 
providing a favorable, climate^ for acpountability practices; 
and (2) a literature .that — by degree-is directed at specific 
practices and applic'a!:ions of the concept in public*^ education. 

T he Literature Supportive^ to Applications of the . Accountabilit y 
Concept in Public Education 

As indicated above, the literature supportive to appli- 
cations of the accountability concept in public education is 
reflected in three broad movements. First, change pressures 
of our times — political, social, and economic change, pressures-- 
are demanding institutional responsiveness to .perceived prob- 
lems, and public education has its share of perceived problems. 
Secondly, technolog ical advances have developed to a point 
where applications of emerging accountabiliety patterns appear 
feasible — at least v;orthy of trying in the absence of "other 
forms of responsiveness. Finally, the emergence of beha^/ioral 
objectives in education has greatly enhanced the ability of 
educators to determine v/hether something has happened with the 
learner. 

Change Pressures. 

An analysis of the pressures of our times should not re- 
quire much elaboration. From even casual attention to the 
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daily news media 'of our society, one is lijcely to get an im- 
pression* that there are degrees -of discontent with public 
education at nearly all levels and in nearly all communities."^^ 
Whether the upset parties be minority groups, students? par- 
ents, taxpayers^ teachers, boards o,f' education, politicians, 4,. 
social ref^rrriers, and/or school administrators, a belief ex.* sts 
that pu£)lic education could and should operate better than 
it does/ And, while .not always in agreement as to whom the 
party should be, it is believed operation can be 'made mor^' 
effective and responsive by holding someone more strictly ac~ ^ 
countable. In sum, these pr^ssui^es create^ a climate of opinion 
for change .within which the notion of accountability has strong 
appeal. As Barro (1970) expresses it: "Under the "account- 
ability banner, otherwise diverse programs for educational 
reform coalesce ^and reinforce one another, each gaining strength 
and all, in turn, strengthening ^ already powerful pressures 
for educati6nal changes." • - » ' - 

A reform-minded line of reasoning is directing, the-'emerg- 
ing"*^ patterns of accountability- into education. This effort can 
be .traced to Washington, D.C. as ^ sort of spillover from the 
launching of the Elementary and Secondary Education Act of 1965 
and the federal efforts since then in the field of compensatory 
educations Simply expressed/ this reasoning • holds that: 

The educational evaluation of the schools arid 
their programs--their' peifformance measurement — 
IS most important. In fact'^ the belief holds 
• that schools should be. monitored regularly' 
with*the results critically assessed and made 
public knowledge. 

* * ^ ^ 

2. A similar', close reporting should be made on 

the cost inputs of Bducatibnal programs and , ^ 

th^ir resulting benefits as derived in measur- 
able cost/effectiveness terms. 

3. . An Old' aducationa;! cliche should be put^to the 

'test and the schools should be held responsible 
^-tor devising programs that "meet the\needs" 

(operationally defined) of all studerits, from. 

the most, endowed to the least endowed. 

4. The people wjiose children are being educated 
in the schools should have a closer partaer- 

ship and form of participation in this matter — ^ 
a partnership v/ith a hand not far from. the controls. 

This line of reasoning received its most forceful public 
expression in President Richard Nixon* S.March 3, 1970, "Message 

.- - 35 ^ _ , 
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on Education Reform," which opened with the flat statement 
"American education is in urgent need of reform/' A ^f ew 
excerpts from this representative message illustrc-*:e the ^ 
above points: ' , ' 

What makes a good school? The old answer was ^ 
/ school that maintained high standairds of plraat 
/ and equipment, that had a reasonable, number of 
children per-classroom, whose teachers had good 
college and often graduate trainingv that kept 
^ up to date with new curricjiilum developments* and - . 
'* v^as^ alert to new- techniques of instruction* ThiSo 
was a fair enough definition so long as it was 
assumed that there was direct connection between 
these school characteristics ^nd the actual amount 
of learning th'at' takes place in a school* 

- V 

Years of educational research/ culminating in the - 
Equal Education Opportunity Survey of i9^6, have, 
however, demonstrated that this^- direct , uncom- 
plicated relationship does not exist. ^ 

' Apart ^from the general public, interest in providing 
teachers an honorable and well-paid -professional 
career, there is dnly "bne important question to be 
asked, about' education: What do the children learn? 

Unfortunately, it is simply not 'possible tb-^ake 
any confident deduction from -school character-^ 
isticsas to what will be happening to the children 
in any particular school* v 

One;, conclusion (however) is inescapable: We do not 
yet\have equal educatiohal op^X)rtunity in America. 

To. achie\)'e^ this .. .reform it will- be necessai;"y to^^ 
develop broader and- more sensitive measurements 
^ of learning than we now have... new measurement of 
educational ^output... ^ ^ ' 

From these 'considerations, we derive another new 
concept: accountability. School administrators- 
and schQOl teachers alike are responsible ior their 
perfjormance, and it is in their inte.rest^'as** w.ell 
as iri the interests "of their pupils that they -.be 
held accountable."^ Success should be measured not. 
by some fixed nationad^orm, but rather by the re- 
sults achieved in relation tOjthe actual situation 
of the particular school and the particular set of- 
, pupils. * " 
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In total,* from the pressures of the times in which we 
live, a literature has emerged that might be labeled the 
rhetoric of accountability . In addition to President Nixon's 
statement. -positive "We-need-it" commentary can be seen in 
.articjLes-an'd'taiks by such public figures as Terrel H. Dell, 
former Deputy Commissioner for School Systems and now Com- 
missioner, U. S. Office of Education (1970); Don Davies, 
former Deputy Commissioner for Development, "U. S. Office of 
Education (1970); U. S. Representative Edith Green of Oregon 
(1970); Governor William Milliken of Michigan (1970); Russell 
Peterson", former Governor of Delaware (1970); and many others. 
An excellent collection of such utterances — "refeifred to ^s _ 
"The Call to Accountability" instead of rhetoric—is found in 
Frefnk Sclera and Richard Jantz's edited work (1972, pp. 3-226). 
These editors provide representative statements from federal, 
state, and local levels as well as from" a variety of spokes- • ' 
men. Additionally, -an extensive bibliography is offered. y 
The mors recent edited work of Richard Hostrop, James Mecklenburger , 
and John Wilson (197.3) offers' a similar (but less extensive) 
"Call to Accountability" section (pp. 1-72) : 

Technological Advances . 

WhiXe the change pressures of our age were building a_ 
publicly receptive climate for accountability, th^ burgeoning 
of new technologies was providing some necessary conceptual 
underpinnings. The sour.ce of this stream again can be traced 
back to Washington, D.C. Faced- with .the task of Solving so 
many problems stemming from the national defense in. World 
War 11 and from the subsequent cold war race for increased 
armament capabilities and space ventures, a series of 'conceptual 
■frameworks were* necessary to permit many different disciplines 
to work together. This series of frameworks developed around 
the notion of "systems." ^t;^ ' , 

A system, simply definad, is a ""set of objects together 
with relationships between the pbjects and between their _ 
attributes" (Hall and Fagen 1956).'- While' this detinition is 
too siceletal to offer much sustenance for initial understand- 
ing, it does express the co^on relationship between the more 
than 40 terms il'sed to express forms t)f its use. At the sAme . 
time, its parallel to the accountability concejit and control 

/ttieory should be noted. . " • . 

i • ■ ^ • . • 

In general, forms of the system concept seek to explain, 
■s rationally as possible, "relationships between objects" . 
in -a manner that permits close scS.utiny of the objects as well 
as how they fit together in a larger, system or. part of a ^ 
system. Usually this explication is done by building and 
analyzing abstract , models of the empirljai world representi-ng. 
the "necessary ^nd sutficient" relationsnips of .the. items 
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being considered. For Anatol Rapcport {]9Ce)/ it moans that 
"general systems theo^ry subsumes an outlook or a methodclogy 
rather than theory in' the sense ascribed to this 'term in 
sci-^nce." 

Thus the systems concept ^^performs an integrative tunction 
in its application and appears to fuse together for several 
purposes the contributions of many disciplines that would 
otherwise be strange bedfollows. The impact of- these advances 
(under tne systems r)anner) on the school administrator, for 
example, 6perating as^ a generalist in the social-behavioral 
science milieu of an educational, organizational, and admin- 
istrative world, is powerful: "It can be used to counter the. 
trend toward myopic f ractionalization of knowledge that renders 
the generalist obsolete" (Hartley 1968) • 

Expressions of ishe systems concept have Assumed many forms. 
In the social sciences alone, multiple system conceptualiza- 
tions Ijave emerged. For example, David Easton (1965) devel- 
oped a framework for analyzing pol-itical systems; the field 
of economics generaT:ed a whole- series of systems analyses 
(including input-output-analysis, econometric models , and ben- 
efit-cost analysis) ; sociology contributed theories of social 
systems through the writings of Talcott Parsbns (19650 -and 
others (March 1965) . Even management found uses for analytical 
^system techniaues, spawning operations research (OR); manage- 
ment information systems (MIS) ; program evaluation and review 
techniques (PERT) ; critical path n^ethod (CPM) ; cost eifective 
analysis (differing from the econoijiic focus of benefit^ cost 
analysis by accounting' for a variety of noneconomic objectives 
also); and plan-prngram-budget systems (PPBS) . Interpretation 
of each of these approachc^s falls beyond the scope of efforts 
here. Their significance for ^is lies in the fact that they 
^ovide a larger variety of ways to view problems — alternative 
ways that are logical, systematic, comprehensive and, above 
all, rational. Reoresentative works of ^his genre of thought 
are reflected in the works of .Itovick (1967), Lyden and Miller 
(1963); and Clelland and King (1969). More direct applications 
to public education will be examined below. 

At its best, systems analysis represents an approach 
through rational technology that seeks to clarify v/hat is- known, 
to isolate what is unknown, to stimulate future behavior, to 
handle fantastically complex interrelationships and, when 
different combinations of inputs are introduced, to yield in- 
sights into the likelihood of future outcomes from alternative 
approaches. As a methodological vehicle for accounting for. 
'differences made by performance, it is ideal. , 
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Behavioral Objectives * ^ 

While new applications of systems concepts were evolving, 
the field of education was at the same time developing a thrust 
vital to any considerations of accounting for educational 
performance, namely, '"behavioral objectives." Receiving , a 
major impetus from the scholarly work of Benjamin Bloom and 
others in the Ta '^onomy of Educational Objectives handbooks 
(1956, 1964) and popularized forms of application in Robert 
Mager*s Preparing Instruct ionsl Objectives (1962) and 'Devel- 
oping Attitude Toward Learning (1968),. the behavioral objective 
movement -has made considerable progress- 

Behavioral objectivists are concerned with educational 
measurement and hold that, if a child learns, his behavior 
will change. This changed behavior, in turn, is possible to 
observe or otherwise measure through various means. Thus, r 
if the child's behavior changes as he learns, it makes sense 
to develop educational goals and objectives in forms of the 
kinds of learner behaviors desired. It then follows that the 
instructional program may be geared to developing these desired 
behavior changes.^, ' * 

While the beha^yioral objectivists were studying changes 
in learner outcomes and shifts in behavior, the educational 
field was l?ecoming. increasingly receptive to this sort of 
thinking. in 1960, Jerome Bruner's Process of Education cap- 
tured the attention of many practicing educators while public 
concerns about the state of American education, stemming from 
Sputnik, Rickover, Conant, and others, helped support an un- 
precedented era of innovation and change in elementary and 
secondary education. Many of these changes (e.g., continuous 
progress education, nongraded instruction, team teaching, in^ 
dividu^lly prescribed instruction, computer assisted instruc- 
tion, etc.\) depend on knowing, with some precision, how the 
student ha^ progressed in his learning. ^ The metl)odology of 
drafting behavioral objectives aids this movement where teachers 
attempt to assess student needs and prescribe objectives that 
ar6 appropriate (i.e., that reflect considerations of the 
nature and needs of the learner, his society, and the content 
to be learned) . 

From behavioral definitions of learner outcomes and in- 
creasing demands of teacher groups for greater rights in 
determining educational decisions, it is but a short step to 
one more conclusion: the responsibility lor moving the learn- 
er, from a state in which he cannot demonstrate ^a desired 
behavior to one in v;hich he can, is shared. The student is 
responsible for making an effort to learn. The teacher is 
accountable for the learning outcomes achieved and for the 
professional effort made in the process. 



23 



- Although the systems technologists and the behavioral 
objectivlsts started their reform movements ^separately, it 
was, as Erick Lindman stated in 1970, '^inevitable that they 
should di-scover each other and find they had so mAach in 
common." Combined with the pressure df the times, the notion 
that accountability could and should be more rigorously ap- 
plied to education gained currency. Why should persons em- 
ployed by the public to provide a service (and given consider- 
able latitude in determining how and under what conditions 
the service will be rendered) be exempt from standing to ac- 
count for the results of that service? 

The premise of this argument is not seriously, or at least 
openly, challenged. The problem lies in the manner of making 
educational accountability operational. The issue of "who^is 
accountable for "what to whom" in education is complex but, 
argue the change pressures of the times, necessary and, suggest 
the new sys.tems-based technologies and behavioral objectives, 
possible. 

Applications of the Accountability Conc ept 

A variety of approaches, singly or employed with others, 
have been proposed to make the public schools more account- 
able by degree. P^t least five broad approaches may be noted: 
(1) developing greater management sophistication among edu- 
ca;tors; (2) use of educational program auditing and public 
information; (3) developing and implementing defined levels 
of performance expectations; (4) quickening institutional re- 
sponsiveness through increased local participation and semi- 
autonomy; and (5) an appeal to an. alternative form of education. 

Developing Greater Management Sophistication Among Ed-- 
^ ucators 

' This approach depends upon acquainting educators generally, 
and administrators specifically, with the developments in the 
sysiems-based technologies, paVJ^icularly those that stress 
inanagement control. Presumably the schools could be made mqre 
accpuntable by making more critical and effective uses of their 
reso^urces through employing these 'technologies * (e.g. , PPBS , 
PERT). For example, in the foreword of a book on educational 
"pro'ject management" (one of the system-based derivatives) , an 
offi'cial of the U. S,. Office of Education contends that demands 
for accountability can be helpfully accommodated with the de- 
velopment of "management sophistication" among educators. He 
maintains: 

, Although the necessity for competent management 
is part of the conventional wisdom of business 
land industry, the concept of educator as manager 
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'is just being accepted—gingerly.' Although 
educators. . .may indeed lilve 'functioned' as - 

-managers — manipulating resources and coping 
with multiple demands to meet certain ends — 
the tools devised by managers in other fields 
have not been available to them, nor has the 
relevance of such tools been immediately 
apparent (Cook 1971) ', 

James' (1969) observed, "More recently a newer priesthood 
of economists and political scientists has joined the. engineers 
in advising government about improving schools, and- schoolmen 
-now have a new catechism to learn." This catechism of system- 
based technologies has come a long way. At least that is what 
the new priesthood believes.. In addition to Cook and Hartley, 
the works of Thomas (1971), Banghart (1969), Kraft (1969), 
Kaufman (1971), and Van Dusseldorp, Richardson, and Foley (1971) 
serve as examples of the "new systems-based catechism applied 
to education. Titles like Perspectives on Management Systems 
approaches in Sduca ti on ' (Albert Yee, editor; 1973)? Account- 
ability; Systems Planning in Education (Greta Sabine, .editor; 
1973); and Robert Thompson's A Systems Approach to Instruction 
(1971) illustrate the systems influence. 

Use of Educational Program Auditing and Public Information. 
These devices stem from traditional public fears that 
people are not being given the full truth about the quality 
of their children's education. To help bridge this credibility 
gap and keep the schools honest in their labors, either an 
educational program auditor (EPA) is employed and/or hard 
data" on school performance (test scores, etc.) is publicly 
■released. In the case of the EPA, this person "audits or 
otherwise critically evaluates specified portions of the school 
program, from specifically designated programs to buildang 
level programs, or even the total district program. Although 
there are several obvious differences between the two roles, 
the EPA acts somewhat similarly to a certifi<-d public accoun- 
cant; both represent an independent, external, quaj-ity-control 
agency- Kruger (1970) notes: 

The Educational Program Auditor does not operate 
the evaluation system, as the fiscal auditor does 
not operate the accounting system — yet both use 
their expertise, objectivdty , and perspective to 
improve the quality of these performance-control 
systems, and thus indirectly influence the quality 
of overall program design and management without- 
diluting the responsibility or authority of pro- 
gram management personnel. 
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While not. neces»sari]^y acvocatincj the specific use of , 
educational program auditors, other worlds are concerned with 
getting before the public an accurate picture of v:hat is 
happening in our schools. Illustrative of such literature 
is Gene Hawe's outstanding article (1972) on the efforts of 
several school districts to report publicly their students* 
achievement test results. A more reflective loo): at the prob- 
lem of presenting public information about the schools v;as - 
undertaken by Wynne (1972) , who vievs accountability as 
"systems ^or arrangements that supply the general public, as 
well as schoolmen, with accurate information aboi^t school 
output performance — test scores and' other data that show hov/ , 
well groups of children are learning in school." Examples 
of'such efforts put into field application are seen in elab- 
orate local district reports like The Columbus School Profile 
(Ohio, 1969), Profiles of Achievement {Tulsa , Okla., 1970), 
and' The' New Rocfielle School Profile (New York, 1971). 

Developing and Implementing Defined Levels of Performance 
Expectations . 

The development of defined performance expectations is 
bound to be the most difficult, and probably the most signifi- 
cant, feature of the accountability movement. As one veteran 
practitioner remarked, "Getting any six people to agree on 
general things in education, let alone behavioral objectives, 
is g6d-av;ful." In 1957 Paul Woodring raised a powerful set 
of questions: Should the schools be responsible for the child' 
intellectual development only, or should they be responsible 
for the individual's social, moral, religious, vocational, 
physical, and emotional development, as v:ell as for the young- 
ster's recreation? If the schools are to be responsible for 
everything, is everything of equal importance, and if no£, 
what is the order of priority--what cones first? Clear answers 
to these questions have never been resolved in, most communities 
and — without local pressure for educational accountability — 
are likely never to be resolved. 7\ccordingly , speci fic educa- 
tional behavioral objectives probably will continue to be 
worked out by school staff members and will be restricted to 
the academic areas in application. 

A more clearly defined consensus concerning v;hat the 
schools should be accomplishing will be' necessary, however, 
if accounts are to be rendered and if people want to know 
whether a difference is being made in the learning behavior 
of their children (i.e., whether their children are learning 
what is intended or not) . Arriving' at a consensus about wha't 
is to be learned in school is no easy task. One superintendent 
describing his lack of success at building a working consensus 
in his community, noted, "There's a lack of good will. That's 
the problem. People cone on as monbers of a political party 



to fight, and they fight." Though difficult, the task is to 
achieve general agreement as to the major educational goals 
of school districts, spelled out .in performance objectives 
to a point where learner progress toward the objectives can 
be assessed with meaning. It should not be impossible to 
develop some graduaiced acceptance of a goal such as "reading 
•with competence," behaviorally defined as Browder, Atkins, 
and Kaya (1973) suggest. ^Indeed, there is pressure for this 
kind of ^ progress from many state legislatures and state ed- 
ucation departments as such" programs the seven-state Co- 
operative Accountability Project (involving Colorado, 
Florida, Maryland, Michigan, Minnesota, Pennsylvania, and 
Wisconsin) imply. (There will be more discussion later on 
determining the "will of the people" in the selection and 
ordering of educational goals and objectives for which to 
stand accountable.) 

/ 

Meanwhile, taking cues from Bloom's taxonomy and the 
earlier works of other pioneers like Robert Glaser (1963) in 
behavioral objectives, an entire field has developed on the 
nature and ways of creating* educational performance objectives 
as well as ways of determining whether or not the objectives 
have been achieved. Cr iter ion-re ferenced forms of evaluation 
of student learning outcomes have come into being. ^ Whereas 
most standardized testing programs in school districts yield 
norm-referenced data (that is, they report on local student 
performance in^'terms of how well the local students compare 
against the statistical performance norms of other students 
across the nation taking the same test,) criterion-referenced 
evaluation concentrates on determining whether an individua^l 
can demonstrate possession of a particular attitude, .skill, 
or piece of knov;ledge. The focus is on what he can or can- 
not do — not on how well he compares with the national peer 
group. In addition to Kemp's (1974) extensive bibliography, 
Keller (1972) also provides a good bibliography on this vast ^ 
criterion testing literature. Articles by Hawes (1973) and 
Millman (1970) offer good insights into applications of cri- 
terion-referenced forms of evaluation. 

Concerning the li^terature of performance objectives gen- 
erally, works by such individuals as Glaser (1963) , Popham 
(1971), Payne (1968), Leles and Bernabei (1969) and many others, 
including critics (Eisner 1967) , .crowd the bookshelves. The 
creation of the Center for the Study of Evaluation in 1966 
and its subsequent Instructional Objectives Exchange (lOX) 
program is perhaps a major landmark in the development of ac- 
countable performance objectives. At the same time, comirtercial 
groups have published criterion-referenced tests, such as 
CTB/McGrav;-Iiill tests in 1971, the "Prescriptive Mathematics • 
Inventory," and in 1972, the "Prescriptive Reading Inventory," 
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or Science Research Associates' "Diagnosi"^ Instructional Aids" 
issued in 1972. 

Developing a consensus and commitment to defined levels 
of , expectations is difficult; implementation of, specified per- 
formance objectives is also. The school system conventionally 
is held -accountable by the^school board primarily for "staff 
performance" (i.e., the staff is held responsible in a general- 
ized sense for 'knov;ing and doing things sup|^osed to help ed- 
ucate the student). Until fairly recently the entire system 
of teacher certification, school accrediting procedures, and 
similar structures buttressed this generalized assessment of 
staff performance. This system is further reinforced by the 
granting of a form of lifetime appointment — tenure--nearly 
automatically or according to length or undisputed service 
within a reward structure based on the "unified salary sched- 
ule," which emphasizes length of service and graduate credits 
as the only significant variables. Such a system depends a_ 
great deal on the individual teacher '3 own sense of dedication 
and professionalism in a profession w.iere there is no defini- 
tion of malpractice. The newer form of accountability alters 
this condition, however, by shifting the focus to pupil per- 
formance (rather than to the staff alone) ; the emphasis is 
plac6d on results, or producing specified levels of student ■ 
accomplishment. .Among the 'more, recent expressions of this 
shift in performance expectations are competency-based teacher 
education, and "external" and "internal" forms of performance 
contracting . 

As a result of the request by the U. S. Office of Educa-^ . 
tion for ways of noticeably improving teacher training in its 
Elementary Models Project in the late 1960s, ten teacher train- 
ing models were developed independently by various colleges 
and universities. Significantly, each of these models tended 
to base itself on the concept that there are certain key 
"competencies" (mastered or acquired skills, attitudes, and 
knowledges) that prospective teachers should be able, in some 
manner, to demonstrate. The idea spread. By 1973 ten states 
had adopted certification changes, and others were planning 
to consider them actively, based on demonstrated competencies 
or performances (Schmieder, 1973). Crucial to competency- 
based teacher education is the use of behavioral objedtives 
known to the' learner and instructor alike prior, to the learn- 
ing experience. Instruction focuses primarily on achievement 
of these objectives. As Houston and Ilowsam (1972) not?, the 
teacher-in-training 'knows "he is expected to demonstrate the 
specified competencies to the required level and in the agreed- 
upon manner. He accepts responsibility and expects to be held 
accountable for meeting the established criteria." The ad-r 
vocates of competency-based training thus hope to peg certifi- 
cation for both teachers and administrators on demons :rated 
. , 34 
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^performances and/or competencies . _ In addition to various 
state departments of education, the American Association of 
Colleges for Teacher Education has undertaken ma^or efforts 
in the area of competency-bas-d teacher education. This move- 
ment has its supporters (e.g., Rosner 1972) and its critics 
(e.g., Broudy 1972). Its future appears uncertain (Uosner 
and Kay 1974) . - . " 

Another Approach, largely conceived by Leon Lessinger 
{1970a, b, c) and focused directly upon specified achievement 
test gains of students, involves the use of peiformance con- 
tracting. Usually an outside, independent agency or firm con- 
tracts with the local school board to attain specified levels 
of student achievement and to be paid in accordance with the 
measure of success obtained. The most publicized experiment- 
to date was the one in the late 1960s , in Texarkana, that city 
straddling the border of Texas and Arkansas. By, fall, ±y/U, ^ 
the Office of Economic Opportunity. ,(0E0) had undertaken the 
funding' direction of 18 such experiments involving six educa- 
tional technology companies, gonside-rable literature began 
to appear (for a good sampling, see Campbell and Lorion 1972, 
and AASA 1972) . On January 31,. 1972, OEO released a statement 
indicating, "There is no evidence to support a massive move 
to utilize performance contracting for remedial education in 
the nation's 'schools.'" While there is evidence that the OEO 
report may have been premature (Blaschke 1972) and that much 
affirmative information on the process exists (Carpenter and 
Hall 1971), the withdrawal of OEO funds as well as- organized 
teacher group resistance (Shanker 1972) has- done much to dampen 
enthusiasm for performance contracting. Certainly claims by _ 
some early evaluations .(e.g.. Performance Contracting m -Ed- 
ucation: The Guaranteed Student Performance Approach to 
Public School System Reform) overstate the case. 

' "Internal" performance contracting is still another vari- 
ation of accountability implementation. Under this plan, local 
teacher teams submit performance contracting bids to their 
board of education. Contract specifications include the in- 
structional objectives, the targeted student population, the 
time period involved, and the educational costs (^'^ • ' ^^^'^^^J^ ' 
overhead, materials, and subcontracting costs f°^.^eacher aides 
from the community or special consultants, as needed) . The 
degree of accountability is negotiated by ^^P^^^^^^^^^;;? ^ °^ 
the local teacher association. The bid awards ^^^^mfH. 
contracts for specified results. Various systems-based tech 
noJSes (e.g., 'plan-program-budget systems and P-g^^ manage- 
ment' techniques) work neatly into this approach. Differentiated 
s?affJng Pa?terns that link salaries with ^^udent achievement 
as well as staff performance also are compatible (English and 
Sharpis llll), under a grant from the Education Professions 
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Development Act (EPDA) , the Mesa (Arizona) Public Schools are 
attempting such a plan. As English and Zaharis (1971) note: 

The value of the internal educational performance 
cqntract is that it^ is regulated by teachers 
through their own professional organization. 
Governance through peer regulation and evalua- 
,tion is meshed with the real reward structure. 
This, in turn, is rooted firmly in client growth. 
Siich an approach may unite accountability and, 
governance at the operational level. 

Internal performance contracting presents an interest- 
ing alternative. 

O^uickening Institutional Respons iveness Through 
Increased Local Participation and Semiautanomy . 
This avenue seeks to increase accountability in two ways. 
The first is expressed by removing the major locus of power 
from the usually more centralized, distant sources and giving 
decision-making powers to the various participants on the 
scene. The second — closely related to developing defined 
levels of performance expectations and publicly reporting 
rdsults--is concerned with applying techniques to ascertain 
the educational will of the people (that is, determining what 
the local community's expectations are for its schools). Thus 
the schools' stewards can be assured they are work:ing on the 
tasks desired by the community-at- large and supposedly are 
supported by said community. 

In the first form, increasing local participation makes 
the schools more responsive via shared decision-making powers 
between school authorities and the people whose lives are 
touched by the schools. In a gross sense, it is accountability 
through political exercise. By concomitantly decentralizing 
the administrative structure, the local administrator Is usu- 
ally more "in harmony^*- (e.^., if ib is a black neighborhood, 
the administrator is black) with the setting of the neighbor- 
hood school and, accordingly, the administrator-on-the-scene 
is more beholden to local groups. His tenure in office depends 
on the community. As Summerf ield • s (1971) Neighborhood- 
Based Politics of Education reveals, such neighborhoods usu- 
ally find their petitions heeded by extremely responsive 
administrators. Gittell (1S67) , Cunningham (1969) , Usdan 
(1969) , and many others describe this political exercise at 
length, leading toward decentralized administrative control 
and neighborhood semiautonomy . 

' At the same time, if local pressure is not sufficient, 
pressure for increased participation comes also from VJashington 
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starting in October, 1970, a memorandum was sent to all chief 
state school officers. Then Acting Educational Commissioner, 
Terrol il. Bell, pressed the issue of parental i nvolvemon t . in 
ESEA Title I projects. Specifically, the local educational 
agency is required to state how its parent councils; 

' 1.^' Provide suggestions on improving projects or 

programs^ in operation ; 

2. Voice complaints, about projects or programs 
and make recommendations for their improve- 
ment 

t 

3. Participate in appraisals of the program 

i 4. Promote the involvement of parents in the 
educational services provided under ESEA 
Title I 

i 

Further, a description is mandated of the means by which 
the local people have an opportunity to inspect the Title I 
application and present their views prior to its submission. 
* Reports also must be filed stating how complaints of parent 
councils on Title I projects have been handled. Such activ- 
ities certainly ought^ to encourage the responsiveness to ac- 
countability that comes through the application of political 
exercise. 

The second avenue seeks accountability through community 
involvement for the purpose of determining the community's 
expectations and establishing its consent for the educational 
efforts undertaken by the schools. Perhaps the most signif- 
icant work currently being done to develop communi ::y- level 
consensus and involvement in the definition of its educational 
tasks is the Phi Delta Kappa project on "Educational Goals 
and Objectives." Developed and field-tested by Keith Rose 
(1971) and Carroll Lang, this "Model Program for Community 
and Professional Involvement" . seeks to involve members of the 
community, the schools' professional staff, and students in 
d) ranking the community's educational goals in order of 
importance; (2) determining how well the schools' current pro- 
grams meet the ranked goals; and (3) developing performance 
objectives to meet the ranked goals. Particularly exciting 
about this approach is bhfe relative success of involving so 
many p<^ople in the process and getting the project completed 
fairly rapidly (within six months to a year) for not too great 
a financial outlay (Lang and Rose 1972) . '» , 

The Delphi Technique is another approach for involving 
many persons in definition and development of a consensus for 
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large-scale organizational goals that subsequently can be 
.broken down into the kfinds of measurable performance ob- • 
jectives which make ^tighter accountability possible. ^Such 
a. technique, originally used to get expert opinion on future 
technological breakthroughs in the defense industry (Helmer 
1967) , operates by asking selected persons to render certain 
^forecasts (if getting ±)est- judgment or expert consensus on the ^ 
likelihood of future events is your goal) or to offer partic- 
ular sets of opinion (if getting community or group consensus ^ 
on goals,, objectives, and their priority is, your aim). This 
is done individually (questionnaire styl?) and withou;t face- 
to-face consultation. The compiled results of the initial 
form of this opinion survey are returned to the participants ^ 
with a request that they review the collective results, change 
their own estimates , .,if desired, or explain why they happen, to 
fall outside the majority range of expression, if suph is the 
case. This 'process may-be repeated two or three times with an 
eventual emergence of some consensus on all issues. The appeal 
of the Delphi Technique to rationality and anonymity allows 
.for the convergence of ' a majority opinion. It "also permits 
- identification of an articulated minority view without the 
usual intense heat, of argument or undue influencing of opinion ^ 
(other than by group pressure) by certain influential persons 
from whom others may take their response cues. Its cumbersome 
administration qualities and other features can reduce enthu- 
siasm for its use (Weaver 1971) , although it does the job 
intended (Cyphert and Garit 1970). 

' A wide variety of other techniques also^ are available for 
determining the educational .will of the people. Operating 
on the opposite premise of the Delphi Technique's attempts 
at minimizing heated conflict by rationalizing the community — 1 
involvement 'process through analysis is the Charette, a French 
term derived from a little cart, or charrette, used to carry 
student architectural exhibits to the. academy for display ^ 
'while the students made frantic, last-minute finishes on thg; 
project. The term came to connote among architects intensive 
"cramming" to solve problems. Applied to community involve- 
ment, it is a process that, by design, meets coi^flict^ head-on 
in an intensive confrontation setting. Used in /ghetto dis- 
tricts of Baltimore, New Jersey, and San Francisco to involve 
the neighborhood community in educational facility planning, ' 
groups of architects, administrators', students, teachers, 
politicians, public officials, and various residents of tSie 
neighborhood met for extended, concentrated periods of time 
to develop consensus solutions to planning problems. Inev- 
itably, conflicts of interest emerge (Williams 1970) . 

The basic rationale of the Charrette is that conflict can 
be created and constructively channeled. This constructive 
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shaping is supposed to occur by reducing the social distance 
between the Establishment (legal authority) and the oth^r 
participants. By creating a situation in which thfe key dey^ 
cision makers of the Establishment, neighborhood representa- 
tives, and others meet face 'to face (a literal translation 
of "democracy in action") in the beTief that the organization 
cannot isolate itself a^ must find support for its operation 
'in the neighborhood, mucl^ faith is placed in the open forum 
manner Oif resolving conflict. V7hen a spirit of cooperation 
emerges from the Charrette (a spirit somewhat similar to 
successful around-the-clock negotiating sessions when key issues 
are resolved) , decisions can be made rapidly and the basis of 
involvement judged fruitful. I*t.is supposed that by open 
decision jmaking, ^rived at by all partj-es, the school will 
be more r.esponsive-— hence accountable — to the people 
XMylecraihe 1971). ^ ' 

A moire familiar approach in gaining an -"accountable per- 
spective"! on the will of the community and forming a consensus' 
among its; members is the technique of polling. For example, 
in'' Oakland County, Michigan, it is possible for schools to 
get information through the use of an "inforet" ^system — an 
"information return" polling procedure that gathers, computer 
analyzes,' and reports information in a month's time.' By using 
consultant expertise, volunteers (housev/ives, senior citizens, 
etc.), random s^plings'of tl^e target populations (e.g., the 
general community, subgroups Within the community, teacherfe, 
and studj'ents) , and a computer to sort' out information-. 
Water ford, Michigan, has been able to keep the 1970 costs of 
the inforet program fairly low — about $250 per polling. 
The volunteers (20 to 30 of them) are trained in telephohe as 
well as face-to-face group and individual interview technique's. 
V7hen possible they use the telephone; questionnaire mailings'* 
are seldom used because of limited response. " On a nomfal, 
single-issue poll, little more than 15 hours of work are re- 
quired "by a single interviewer to produce 95 percent re- 
liability" {Stark"1971) . ^ ; , 

As a feedback^ system to clarify the otherwise Amorphous- 
appearing will of the community served by the schools, 
techniques like inforet, properly Applied, appear^^u^ef ul . 
Quickened institutional responsiveness through definition 
of the community's standards of desirability (its goals) as 
well as identification of areas of difficulty and community 
priorities seem possible. An idealized view of what should 
occur between the community and the schools is illustrated 
in. the. 1971, version of the Joint Committee on Educational , 
Goals and Evaluation of the California State Legislature's 
"Prir\ciples of School-Community Planning and Action": , 
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Th^ board .of education and superintendent of 
school^' should jointly propose and initiate-* 
the goal-setting procefes as a response to feljb 
needs within the community • * 

.Every community member r should be invited to 
participate in the goal-settin*^ process • 

The search for goals and objectives relevant 
tor^ education in the 1970s should be the^ start 
*of on-going effort to involve the community 
in school policy development* 

'The goal-setting process should be Hept open . 
to all points of vigw without, domination or 
intimidation by any special interest glroup/ ' 

vThe purpose of bringing people together is 
not to dwell on past deficiencies, or lay 
blame, but to evolve a philosophy, identi-^5^ 
needs - determine goals and p'rogram objectives, 
and establish priorities. 

Participants should not* expect to have every-, 
thing their way; they shyDuld come seeking a 
better understanding o^tlife community, its 
people and problems. 

A spirit of cooperatioA and trust dhould be 
established among individuals a*nd groups 
involved in the process. 

Roles of leadership in school-community 
planning should be earned on the basis of ^ 
consensus .rather than .on authority. 

Individuals, and -groups that are instrumental - 
to the goal-settinig process- should provide 
.for the , open 'flow of information. . . 

The in^diyidual .school should be^-the ba'se ^ , 
of-^ operation for ^bringing, people iiogether. 

In the process' of determining ^goals ^and 
objectives, opinion must be balanced* ^ 
with fact. - • 

The interaction process must begin with ' . 
concerns which hav« high, priority for the 
jjeople involved. 
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13. The school board should' commit the re--^ 
sources necessary 'to see the ^goal-setting 
process through to a satisfying conclusion; ' ^ 
bo'ard members should be encouraged to 
participate in the interaction process, 

not as board, members, but as pri^/ate citizens. 

14. Teachers and administrators should honor 
their responsibility to the co^unity by 
taking an active part in the goal-setting 
process . 

ij. A variety of meetings shoui4 be .held as 
part of the goal-setting procass; mixed- 
groups assist consensus -building . 

16. Inasmuch as Lhe^ learning process is recog- 
nized as dynamic ari<3 individualistic, any r 
objectives of education that are established 
should not be so specific o'r restrictive 

as to preprogram the learning process for 

any student. . | . ^ 

17. To ensure that the goals and objectives of 
public education continue to be relevant, 
a recycling process should be designed; ^ 

lb. The 'goax-setting and planningrprocess should 
result in "^bbservable action. . . 

\ Anyone familiar with the operations of a ^public school 
district will recognize how idealized thes^ principles are. 
On the other hand," collective- bargaining agreements with , ; 

teachers and- other groups have taken away or ignored much of • " 
what used to be a community affair which involved the public, 
the PTA, and others in the running of the schools. Efforts 
to reestablish and/or broaden the school's, accountability to 
the community through increased participation, lay involve- 
ment, and- semiautonomy promise to be <^ifficult, especially 
where strongly profiled positions of devergent self -Intercast 
exist.' In such vjases, only state legislation mandating such 
an involvement process is likely to /establish its use ex- 
fcenEivcly. Many stat.^ legislatures/ already have mandated 
comT.unity involvement (Hawthorne 1^12) . 

y 

Ap'pe 'nc to an Alternative Uorm of Education . . 

Pnother expression of accountability in education is- based 
on a sor^- of "consumer's choice", logic . Through the use of 
"Pducational vouchers," r. parent can pay for the^4 schooling 
of his choice, provided there is a selection of alternative 
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schools available and the parent is sufficiently dissatisfied 
with the educational fare at the local public school. Pre- 
sumably, through competing forms of publicly financed educa- 
tional systems (public and semiprivate) , the parent can hold 
schools accountak^le by exercising alternative ' choices . While 
some individuals view the voucher plan as a form of account- 
ability .(Carr and Hayward 1970) , .it falls outside the scope 
of the emerging accountability patterns defined earlier. 
Christopher Jencks (1970) an4 others developed arguments for 
the educational voucher which were sufficiently strong to 
warrant its current testing at Alum Rock, .California, and 
proposed trial in New Hampshire under the auspices of £he 
National Institute of Education. 

While alternative forms education through vouchers 
have special appeals of their own — particularly in higher 
education (Levin 1973) — and are seen by , some as. expanding ^ 
the accountability of educational institutions by increasing 
the ability of persons to "vote with their feet" ,for i:he kind^. 
of institutions they choose to^ attend, it not apparent 
what particular qualities alternative formj :if education 
possess that increase accountability as the concept is used 
in this monograph. 

i 

In Sum* . , 

Several avenues to greater accountability in education ' 

seem available, taken singly or in concert with others. There 

are at least four broad expressions for increasing accou^t- 
■^bility, with a fifth approach also being considered. -^How 

suc:cessful any and/or all of these applications might be will, 

have to be determined in measures of degree. 
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CHAPTER V 

AN OVERVIEW OF ACCOUNTABILITY MODELS 



Putting together all the elements discussed ''in order 
to render a better account of the differences made, what 
picture emerges? A picture of the full-blown pattern 
emerges in a U. S. Office of Education memorandum from 
Technical Assistance Coordinator, Stanley Kruger. 

This document serves as a prototype embodiment of. the 
elements in a fully developed accountability model. Accord- 
ing to this April 3, 1970, memo, the Division of Plans and 
Supplementary Centers (DPSC) distributed it "in an effort to 
promote the implementation ^of accountability in DPSC programs 
to a greater extent than has been accomplished heretofore," 
Twelve factors were "identified as being critical to the 
process": 

1. community involvement: utilizing members ^ 
of concerned community groups in appropriate 

^ phases of program acitvity in brder to 

facilitate program access to coirimunity Re- 
sources; community understanding of the 
program's objectives, procedures, and accom- 
plishments, and the discharge of program 
responsibilities to relevant community client, 
service, and support groups. 

2. Technical assistance : providing adequate 
resources in program planning, implementation, 
operation, and evaluation by drawing upon 
community, business, industrial, labor, ed- 
ucational, scientific, artistic, social/welfare, 
and governmental agencies for expertise and 
services necessary for effective operations. 

3. Needs assessment: identifying target jroup and 
situational factors essential to the planning 
of a relevant program of action. 

4. Change strategies t developing effective 
strategies for systematic change in the 



educational enterprise and incorporating 
the strategies into. program operations. . 

5. Management systems: adopting the systems 
appro.ach — through such techniques as MBO, 

^ PPBS^PERT, and CPM — to educational program 
management at the local , state, and federal 
levels. 

6. Performance objectives: specifying program 
objectives in a comprehensive, _precis^ 
manner that indicates measures and means 
for assessing the. degree of .attainment of 
predetermined standards . 

7. Performance budgeting : axlocating fiscal 
resources in accordance with program objec- 
tives to be realized, rather than by objects 
or functions to be supported. 

8. Performance contracting: arranging for 
technical assistance -in program operations 
through internal or external contracts that 
condition compensation upon the accomplish- 
ment of specified performance objectives. 

9. staff development : determining the nature and 
extent of staff development needed for the 
successful implepientation of^ the account- 
ability concept at the local, state, and federal 
levels, and the design and conduct of indicated 
development activities . 

• 10. Comprehensive evaluation: establishing sys- 
tems of performance measurement based on the 
continuous monitoring of the program's oper- 
ational and management processes as well as 
assessment of its educational and other re- 
sultant products. 

11. Cost-effectiveness : analyzing unit results 
obtained in relation to unit resources 
consumed under alternative approaches to 
program operation as a determirtant in con- 
tinued program planning. ' 

12. Program auditing: setting up a p'^rformance 
monitoring systen^ based on external reviews 
conducted by qualified outside technical 
assistance, designed to verify the results 
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of the evaluation of an educational pro-- 
gram and to assess the appropriateness 
of program operation and management* 

• In part/ taking cues from the federal efforts, 1973 
Hawthorne reports 23 states had passed some form o^ account- 
ability legislation with a, majority of these requ^ ing a 
state "proof-cf-results" tesing or evaluation pr^ /ram. Seven 
states request plan-prcgramrbudqet-system forms educa- 
tional accounting, and eight b .e^ statutes for evaluating 
the professional staff. There is* considerable diversity be- 
tween states in terms of the language and content of some- 
times similar pieces of legislation; some of the legislation 
is **hard" (i-e., explicitly prescriptive) and some ''soft" 
(loosely" defined) . A compilation of state legislation and 
its interpretation is being maintained by the State Educa- 
tion Accountability Repository (SEAR) under the auspices of 
the State ^Department of Public Instruction in Madison, ^ 
VJisconsin. 

Typical of efforts at the state level is Michigan's 
accountability ^model developed by the State Education 
Department under the leadership of Superintendent John 
Porten* It is desc;rabed, in part, as follows: 

The model highlights the" need for common goals 
of education, development of performance ob- 
jectives rather than textbook completion,^ 
assessing needs, analyzing the ways in which 
teachers teach, and providing outside educational 
audits to determine if changes have indeed " 
taken place, in addition to providing guar- 
anteed in-serviae professional development* 

This model is a process, not a curriculum im- 
position. Along with being continuous and 
circular, the model is envisioned a3 enhanc- 
ing the role of the teacher in the educational 
process of preparing our children and youth 
fox' adulthood* 

In a sense, use of the educational account- 
ability model is analagons to program budgeting 
in the business world. It involves planning, 
acting, and evaluating; it is a tool to be 
employed, or h road map to help lead the ed- 
ucator or citizen get v;here he wants to go (1972) • 

The Michigan model contains six general categories, 
"thrusts," or steps toward increased accountability: 
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Ster J: Common Goals. The State Board of 
Education has articulated certain goals for 
children. These are spelled out in general 
terms in the common Goals of Michigan' Ed- 
ucation. Each local district is asked to ' 
develop its own modifications of tliese goals. 

Step 2: Performance Objectives . There are, 
by consensus and by definition, certain 
things it is assumed children ought to know 
at various stages in their development. This 
information must now be translated into per- 
formance measures. While much work remains , 
to be done, the performance objectives fall • 
naturally into skill areas and attitude- 
aspiration areas which are, psychologically 
speaking, in the cognitive domain, the psycho- 
motor domain, and /or the affective domai,n. 

Step 3: Needs Assessment . Having identified 
the goals for children,, and having articulated 
the performance objectives for schools, it 
is necessary to assess the existing relation- . 
ship between goals and objectives. This 
analytical chore must utilize all the knowl- 
edge at hand: research findings, testing 
results, resource distribution, personnel 
availability, and a hpst of other factors. Thee 
objective is to give local school officials 
some notion pf the variance between desirability 
of performance objectives and what the child 
or children can do (needs assessment) . 

Step 4: Delivery Systems Analysis. Based on 
needs assessment, plans must be made to change 
the delivery systems to reverse what has often 
been termed as the "push-out" or "leave behind" 
problem. Among the many things which may be 
used are performance contracting , compensatory 
education, promising practices from experi- 
mental and demonstration schools , year-round 
schooling, intensified preschool education, 
improvement of nutrition through school meals, 
in-service training of teachers, and many others 

step 5: Evaluation and Testing. If a change 
takes place in the delivery system, that change 
needs to be tested and evaluated. If valid, 
across-the-board in-service professional de- 
velopment programs should be fostered. 
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. step 6: Recommendations for Improvement. V7hen 
a district or school has gone through these 
steps, it should feel abligated to ^share ,the 
results. Recommendations to the. local district, 
and to the [Michigan] State Board of Education 
complete what is essentially a circular pattern 
of service — goals are served and/or modified 
on the basis of continuing attention to the suc- 
cess or lack of success in the educational 
delivery system, and the process starts over 
again. 

In this manner Michigan's Department of Education hopes 
to determine whether or not their schools make a difference 
and to act where the difference made is not favorable. But, 
as the Department observes: "To some, consideration o.f an 
accountability model or new elements in education has appeared 
to represent a threat or a challenge S:o historically developed 
educational approaches and a judgment as to the efficacy of 
such approaches at this point in time. No threat is intended. 
Plainly/ however, the Michigan Education Association perceives 
it as a threat, circulating literature and cartoons depict- 
ing State Superintendent Porter on a steamroller marked "Ac- 
countability," flattening teachers and students. 

In addition to resistance from Michigan teacher- groups, 
the Michigan Accountability Model has received criticism from 
other quarters. In their generally negative study of its 
implementation and operation, Ernest House, Wendell Riveras, * 
and Daniel Stufflebeam (1974) charge that: 

— the system's common goals have not been suffi- 
ciently clarified ' 

— the objectives were developed by relatively 
few people and thijs do not represent a broad 
consensus 

— the Department of Education has been unable 
to give much help in developing evaluation 
systems within local schools 

— the assessment efforts are: (1) too narrpw in 
scope (testing mainly reading and arithmetic 
at two grade levels); (2) not always appro- 
priately valid for what is taught locally; (3) 
putting assessment results to questionable use; 
and (4) not being supported widely 

At the same time. House, Rivers, ^and Stufflebeam concede 
that the model has: 



— stimulated public discussion of educational 
goals and given direction to' state efforts 

— involved educators throughout the stat6 in ' 
educational objectives deve'lopment 

— resulted in pilot forms of ob jectiv3S-ref erenced 
tests which some teachers find useful 

— worked generally to create an aura of innova- 
tion and change- 

e 

The House-Rivers-Stuf f lebeam team favors a slower rate 
of the model's development; matrix sampling (rather than state 
testing all students); making state assessment voluntary for 
•local districts (thus making it a negotiable item for teacher 
groups) ; and channeling more state help into developing local 
school-based (rather than State Department of Education-based) 
evaluation systems. They eschew "the absurd pra.ctice of tying 
[state] .money to gains in achievement scores" (1974, p. 669). 

In turn (and without prolonging this discussion) , the 
Michigan Department of Education has defended its model and , 
raised some legitimate questions and issues about the House- 
Rivers-Stuff lebeam critique (See Kearney, Donovan and^ Fisher, 
1974) . Continued debate can be expected. 

I Applied to local levels, the creation of accountability 
models carries a range of advice for practitioners attempting 
tp implement such models. The literature holds a variety 
of Qftveats expressed as "imperatives." For example, Lopez 
(1970). warns that accountability* programs must (1) pay 
attention to communicating with all parties; (2) have an 
organizational philosophy or plan of action that has the 
allegiance of everyone; (3) be specific about its purpose; 
(4) improve the performance of all persons involved; (5) be 
sensitive to human needs; and (6) have all persons who are 
touched by the program participate in its development from 
start through finish. 

Mazur (1971) joins Lopez in pointing out potential ac- 
countability model pitfalls. He maintains- one should avoid 
(1) making unrealistic administrative demands; (2) forcing 
accountability programs on unwilling and uncomprehending 
staff;. (3) perceiving accountability as an end rather than 
a means; (4) moving forward with a shallow understanding of 
accountability policy and procedure; (5) having too great 
expectations f rom Yi^^i^^l procedures and small resources; 
and (6) placing tqp much faith in the reliability of account- 
ability measures fthe criterion problem) • 
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Mazur's own positive'' imperatives are brief: one must 
have a trained staff and- the opportunity to employ account- 
ability procedures and must possess the capability for gen- 
erating information appropriate to planning and development. 

Cunninaham (1971), v/riting about decentralization and 
community control, offers the following imperatives for 
program design: (1) responsiveness to the participation 
impulse in people; (2) movement toward demonstrably improved 
education; (3) recognition of the "equality of opportunity" 
mandate; (4) accommodation of lay-prof«©ssional antag-onism; 
(5) financial .feasibility; and (6) politically attainable 
goals. 

V tthout attempting to exhaust imperative listings, it 
might not be an exaggeration to conclude there are nearly as 
many listings- as authors; one may pick from among the many 
edited works of Browder (1971) Educational Testing Service 
(1971), Roberson (1971), Lessinger and Tyler (1971), Sciara 
and Jantz (1972), and others. At the same time, the listings" 
tend to be similar in many respects. Unfortunately, it is • 
rather unfair to merely summarize imperatives like a grocery 
list and forego the closely written explanations with which 
these model designers butress their points,.. The purpose here, 
however, is to alert the reader to the fact that there are 
multiple and differing caveat emptor ^ signs dotting the land- 
scape, (not to lead him by the hand to each one). 

Among the more ambitious works in creating performance- 
based accountability models for local application is Browder, 
Atkins and Kaya's Developing an Educational'ly Accountable 
Program (1973). This publication too offers imperatives. o 
It states the program must: (1) have knowledgeable designers; 
(2) lead to improved education; (3) recognize and accommodate 
diverse -forms of participation; (4) train personnel before 
and during implementation; (5) fulfill the conditions of their 
accountability concept; and (6) be judged politically at- 
tainable. 

Using the U. S. Office of Educations' s 12 elements cited 
earlier and their own imperatives; Browder, Atkins, and Kaya 
weave these items into a four-phase model with critical and 
optional features. Skeletally expressed, the model follows 
a process for developing the author^' interpretation of an 
educationally accountable program for a loral school district.: 

Phase 1 Preliminary Planning ' 

©Assess, needs (critical) 

•Develop a preliminary change strategy (critical) 
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•Consider the-uso of technical assistance *and 
^management systems (optional) 

^Make a decision to move, or not to move, to 
Phase 2 



Phase 2 : Formal Planning 

•Involve the community and staff (critiqal) 

— Repeat the needs assessment (optionsl) 

— Repeat the change strategy development (optional) 

•Develop goal consensus and performance ob- 
jectives (critical)' 

•Consider use of a plan-program-budget-system 
(optional) 

•Develop criteria for program evaluation (critical) 

•Make a decision to move, or not to move to 
Phase 3 



phase 3: Program Implementation 

•Develop the program's staff before and during 
implementation (critical) 

•Implement program procedures (critical) 

•Consider 

— Use of external' and/or internal performance 
contracting (optional) 

— Use of management-by-objectives, project 
management, and network monitoring pro- 
cedures (optional) 

•Reach predetermined completion points of pro- 
gram efforts 

Phase 4: Render i nj the Account 
•Evaluate the program (critical) 
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■> •Report the results (critical) 

•Use an educational program auditor (optional) 

•Make a cost effectiveness analysis (optional) 

• Determine the level of "Confidence issue 
(critical) 

•Certify the nature of the results (critical) 



Again, like the imperatives, models abound also; Fair ley 
(197,3) presents a model for a federal ac§;ountability system; 
three teams of prestigious researchers present models for the 
Ohio Department 9f Education (1973)'; Rand and Stover (1971) 
present "a field-proven modfel" for Temple City, California; 
Pilot (1972)= offers a "system accountability" for Sarasota, 
Florida; Niedermeyer and Klein (1972) devise a modal for 
"Staff Performance Improvement and Appraisal" in Newport-Mesa, 
California;- Berry (1974) developes "An Alternative Account- 
ability System" in Alta Mesa, California; and so on. What 
may one conclude? Performance-based accountability models 
in public education come in all sizes, shapes, and degrees of 
sophistication. 
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CHAPTER VI 



SOME CONTINUING ISSUES AND CONCLUDING REMARKS 

What problems and issues continue to arise? As mentioned 
earlier, the history of accountability in its sharpened form 
is stiLl ^too brief to supply the kind of empirical data base 
necessary to^ form a judgment of its value 'to education. It 
is simply too early ii) i±s ^development to be certain. 

On the other hand, what other rationally based system 
exists for seeking measurable performance from those entrusted 
to produce it — a system that holds more promise for determin- 
ing differences made on publicly educated learners? No other 
system appears unless one takes a position that the process 
of public education should not seek "to m^ke a difference" 
by maximizing rationality, operational efficiency, performance . 
measurement, and clarity of responsibility. And there are 
those wh6 believe that public education should not seek "to 
make, a difference" (Leight 1973) and should have learned some- 
thing from, its earlier flirtation with' rationalized "efficiency 
(Callahan 1962) . 

« 

It is more nearly an issue of degree. No serious- observer 
advocates the total absence of accountability, and very few 
persons appear willing to push it to its theoretical limits. 
A key issue in the current movement is: to what degree^ can ' 
(and should) we really^hpld people and programs accpuntable? 
Typically, one is asked to accept a' pragmatic answer: to a 
degree that is more than generally practiced but is far less 
than theoretically possible. One reason for this answer is 
that the machinery for enacting accountability measures is 
stol-l-^being pierf-ected, and, while it has gotten "beyond the 
threshold of primitive development, its usage has not reached 
level of confidence akin to Caesar's wife. A second reason 
^is found in human nature. A few people may regard themselves 
accountable to no one or for nothing; most will acknowledge 
a generalized accountability and very few seek extensive 
accountability. To date, education has not called for the 
kind of %ccountalDle precision necessary for the launching o^ 
rockets in a space venture. This degree would be too cum- 
bersome, unwieldly, and impractical for today. By the year 
2001, who knows? 



In the-ifleantime; the issue for public education becomes 
one of establishihg a standard of desirability concerning 
"how much" accountability, what kind> and under what condi- 
tions. Resolving this issue, tangled as it is in conflict- 
ing values and points of view "as we'll as opposing strategies, 
will probably depend as -heavily on political, social, and 
economic considerations as those factors purely educational 
in nature^. The phrase, "negotiable accountability," captures 
the spirit of this issue..' A^d, as one discovers in practi-ce, 
everything^ in public education", one way or another, becomes 
negotiable between ^stewards and reviewers. A-major hope of 
accountability-linked systems is tfiat they will yield more 
valid and reliable data xm the inputs, the process, and the 
outcomes of educational organizations. This information, in 
turn, supplies the basis for negotiating responsibility, more 
rational d^isidn making; and more informed levels-of- o 
confidence judgments. In its absence, one party's claim is 
as good as another's. 

Probably the greatest strength of the accQiantability 
concept in pujDlic education — a strength bound to be felt in 
the negotiation process between st.ew^rds* and reviewers — lies 
in the rationale of its sup^porting assumptions. These as- 
sumptions hold that: , f * ' 

— The schools exist primarily to produce 

publicly, endorsed .changes in the learning ' 
*behavior of their^major client, the student. 

— Leaning behaviors, expressed as out^comfes, 
can be achieved in multiple ways, some 
more effective than others. 

— Because the resources ^ (time , money, staff., 
^ etc. ). available in any shcool district are 

custpmarily less than the demands made 
, upon them, it is encuijibent upon the admin- 
istrative staff to seek and recommend an 
optimum^ balance between the available re- 
sources and the most effective means of 
expending them in attaining publicly en-s 
/ . dorsed goals and objective. 

— Without the presence of some form of ac- 
countability process, it^ is difficult or 
impQSsible to gauge learner progress well — 
either by individual or group — or instructional 
effectiveness for the purpose or decision 
' making. 
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— Programs carrying the conditions of the,"* 

accountability process lend themselves 

to- better, more informed kinds of deci- . 

sion making for seeking the optimum » 

balance betweer>' resource expendituifes 
_ "^and learning ach^eveiT>€nt. 

*' — Given sufficient time and operation, pro- 
grams identified by the 'accountability 
• process as "ineffective" (i.e., failing 

to pass the level-df-conf idence review of 
-rfisuits) should be either modified, elim- 
inated, or replaced by more effective 
. . ' programs.' -.^ . , 

, _ ''^---'Th^ accountability process, linked to per- 
formance measurement is a vehicle that 
holds promise for improving learning out- 
comes^/^jieci^io'n making, \ and rational 
adjustments to change pressures .iri an in- 
terdependent, technological society. 

The' validity of any of these assumptions is open to 
question. Accordingly, these assumptions can become issues^ . 
in themse^es. o ' . . 

It^iS/ however, between these assumptions and their ' \ 
translation^ into practice t{fat?,the more commonly heard 
issues remain: Who is accountable to whom for what? Is it 
possibly to develop a set of effectiveness i^ndicators that 
really indicate effectiveness? Is the present state-of-the- 
art of evaluating learning outcomes ^able tp yield useful and 
valid ineasurements for accountability purposes? These i'ssues 
continue, to fill the literature. 

In conclusion it would appear that. With the passage 
of «time and with continually^ improving educational techno- 
logicalabilities, even those individuals "who currenta.y claim 
it is not possible- to* obtain the proposed standlards of ac- 
countability reflected in accountability models lik-e 
Michigan's (accepted ^by many today as being operable) will 
come to accept the ^'dea that education possesses the capa- 
bility. It can be^ done. ^ • 

The Issue ofi willingness to do so is another matter • - ^^^^ 
Powerful unions have, fpr years and for various reasons, 
withstood, pressures to make changes that would improve 
practice in their fields. Other groups too, fearing their 
interests threatened or simply not trusting change, do not 
respond with enthusiasm. Even society itself, in areas like 
ecology, showss a slowness to respond to needed and technolog- 
ically possible changes. One bf the challenges of the current 
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situation is to .demonstrate the importance of accountability' 
pur^pose over its many techniques. The willingness of people 
to listen, believe, and act 6n this information remains to 
be seen. As Frank Schmidtleih observes: 

"...a focvTs on the, willfitl behavior of people, 
which is the usual objecti of auditing. and 
attempts to strengthen accountability. Is 
particularly ineffective since people's values 
and ideologies are highly' resistant to change" 
(1974,/p. il>. 

Yet public education today is under enormous pressures 
to change. It will .arqe. Exactly how and when, however, 
remain uncertain. . Ii» meantime, who's afraid of edu- 
cational accountability^ ► 



/ 



55 

49 



REt ERENCES 



Alameda County School Department, implementation of the 
S,vull Bill. Hayward, California, 1972. 



Marvin C. Alkin, "Accc antability Defined," EvaVvation 
comment. May, 1972, 1 (3): 1-5. \\ 

American Assooiation of School Administrators, Thj School 

Executive' s Guide to Performance Contracting. PJkSA, 1972. 

Frank Banghart, Educatio.nal Systems Analysis. Macmillan, 1969. 

Stephen M. Barro, "An Approach to Developing Accountability 
Measures for the Public Schools," Phi Delta Kappan. 
December, 19/0, 52: 196-205. 

Norton Bedford, "Managerial Control," in Contemporary 

Management: Issues and Viewpoints , ed. by J . W. McGuire. 
Prentice-IIall, 1974. 

Terrel H. Bell, "The New Look of Federal Aid to Education," 
Speech to the Michigan Association of School Boards, 
Grand Fipids, September 24, 1970. 

Janet Berry, "Accountability: Can Teachers Make Progress 

Committments for Individual Children?" Phi Delt=> Kappan. 
February, 1974, "55: 420-21. 

Charles Blaschke ,, Perf or/nance Contracting: Who Profits Most? 
Phi Delta Kappan Educational Foundation, 1972. 

Benjamin S. Bloom, et. al.,"eds.. Taxonomy of' Educational 
I, Objectives, Handbook I: Cognitive Domain. Longmans, 
Green, 1956. . 

Harry S. Broudy, fl Critique of Performance-Based Teacher 

\ Education.. American Association of Colleger for Teacher 
^ Education, 1972. 

Lesley H Browder Jr., An Administrator ' s Handbook on Educa- 
'tional Accountability. American Association of School 
kv-ioinistrators, 1973. 

\ 

\ ' , ed.. Emerging Patterns of Administrative Account- 
a^bility. McCutchan Publishing, 1971. 



, VJilliam -Atkins and Esin Kaya , Developing an Educa- 
TlSnally Accountable Program. McCutchan Publishing, 1973. 

56 

51 



Jerome Bruncr, Process of Lducaiion. Harvard University 
Press, ] 962. 

Raymond Callahan, Education arsd the Cult of Efficiency . 
Univeisity of Chicago Press, 1962. 

Roald Campbell and James Lorion, Per f orm^ncc Contract mg in 
School Systems. Charles E. Merrill Publishing, 1972. 

Polly Carpenter and George Hall, Case Studies in Educational 
Performance Con tract Lng : Conclusions and Implications. 
RAND, 1971. 

Ray Carr and Gerald Hayward, "Education by Chit: An Exam- 
ination of Voucher Proposals," Education and urban 
Society. February, 1970, 2: 179-191. - - 

Dorwin Cartwright, "Influence, Leadership, Control , " 

Handbook of Organizations , ed . by J. G.. March. Rand 
McNally, 1965, pp. 1-47. 

David Clelland and William King, eds.. Systems, Organizations, 
Analysis: A Bcok of Readings. McGraw-Hill, 1969,;' 

Columbus Board of Education, The Columbus School Profile. 
Columbus , Ohio, 1969 . / 

Desmond L. Cook, Educationa 1 Project Management . Charles E. 
Merrill, 1971; 

Luvern Cunningham, Governing Schools: i^'ew Approaches to Old 
Issues. Charles E. Merrill, 1971. 

^, "Trends and Issues in Participation," Theory into 

Practice, October, 1969, 8:' 203-206. 

Richard Cycrt and James March, A Behavioral Theory of the 
Firm. Prentice-Hall, 1963. 

Frederick Cyphert and Walter Gant, "The Delphi Technique: 
A Tool for Collecting Opinions in Teacher Education," 
Jounal of Teacher Education. Fall, 1970, 30: 417-425. 

Don Davics, "Tho 'Relevance' of AccOuntal^j 1 i ty , " Journal of 
Teacher Education , Spring, 1970, \21: 127-133 . 

Henry S. Dyer, "Toward Objective Criteria of Profossiona] 

Accountability in the Schools of Nov. York City," Phi Dalta 
Kappan. DcjemL.r, 197( , 5?: 200-2]]. 



Dayid Easton, A Framework for Political Analysis. Prentice- 
Hall, 1965. 

f 

Educational Testing Service, Conferences on Educational 
Accountability. ETS , 1971. 

Education Turnkey Systems, Performance Contracting in Educa- 
tion: The Guaranteed Student Performance Approach to 
Public School System Reform. Research Press, 1970. 

Elliot W. Eisner, "Educational Objectives: Help or Hinderance?" 
School Review. 1967 , 75 : 3 . 

Stanley Elam, "Holding the Accountability Movement Accountable,'* 
Phi Delta Kappan. June, 1974, 55: 657, 674. 

Fenwick English and Donald Sharpes, Strategies for Differ- 
entiated Staffing. McCutchan Publishing, 1972. 

, and James Zaharis, "Are Accountability and Govern- 

ance Compatible?" Phi Delta Kappan. February, 1971, • 
52: 375. 

Amatai Etzioni, "Organizational Control Structure," Handbook 
of Organizations, ed. by J.G. March. Rand McNally, 
1965, pp. 650-677. 

, The Active Society. The Free Press, 1968. 

Richard L. Fairley, "Accountability in a Federal Education 

Program," unpublished Ed.D. dissertation. University of 
Massachusetts , 1973 . 

John Fiorino, Di^f^erentiated Staffing: A Flexible Instructional 
Organization . Harper & Row, 1972. 

Marilyn Gittell, Participants and Participation . Center for 
Urban Education, 1967. 

Robert Glaser, "Instructional Technology and the Measure- 
ment of Learning Outcomes/' American Psychologist. 
1963, 18: 519-21. 

Edith Green, "The Business of Education," i^at ion's Schools. 
December, 1970, 86: 40-45. 

A. D. Hall and R. E. Fagen, "Definition of System," Generai 
Systems I. Yearbook of the Society for General Systems 
Research , 1956 . 

58 



53 



Harry Hartley, EducatJ -^nal Planning-Programming-Budgeting: 
A Systems Approach, Prentice-Hall, 1965. 

Gene R. Hawes, "Criterion-Referenced Testing," Nation's 
Schools. February, 1973, 90(2): 35-41. 

; "Releasing Test Scores: Urgent or Unthinkable?" 

/Nation's Schools. April, 1972, 89 (4): 41-55. 

Phyllis Hawthorne, Characteristics of and Proposed Models 

for State Accountability Leg islation . Madison, Wisconsin 
State Educational Accountability Repository, 1973. 

Olaf Helmer, Analysis of the Future: The Delphi Method. RAND, 
,1967. 

R. Jean Hills, "On Accountability in Education," Educational 
Administration Quarterly , Winter , 1974, 10: 1-17. 

Richard Hostrop, James Mecklenburger , and John Wilson, eds.. 
Accountability for Educational Results. I^annet Books,' 
1973. 

Ernest R. House, Wendell Rivers, and Daniel L. Stufflebeam, 
"An Assessment of the Michigan Accountability System," 
Phi Delta Kappan. June, 1974, 55: 663-669. 

Robert Houston and Robert Howsam, eds., CompetencyBased 

Teacher Education . Science Research Associates, 1972. 

H. Thomas James, "Public Expectations," Conference on Ed-- 

ucational Accountability . Educational Testing Service, 
1971. 

, The Uew Cult of Efficiency^ and Eduration. Horace 

Mann Lecture Series, University of Pittsburgh, 1969. 

Christopher Joncks, "Giving Parents Money for Schooling: 

Education Vouchers," Phi Delta Kappan. September, 1970, 
52: 49-52. 

, ct. al.. Education Vouchers: A Preliminary Report 
on Financing Education by Payment:^ to Parents. Center 
for the Study of Public Policy, March, 1970. 

^, et. al.. Inequality . Basic Books, 1972. 

Frank Jennings, "For the Record," Teachers College Record. 
February, 1972, 73: 333-337. 

' 59 



54 



Joint Committee on Educational Goals and Evaluation, Edu- 
cation for the People, California State Legislature, 
1971. 

Philip Jones, "How One School Board Judges, Rewards — and 
Penalizes — Its Superintendent on the Basis of His 
Performance," American School Boar'd Journal. February, 
1974a, 32-36. 

' , "How to Make Your Staff Accountable for What It Does-- 

Not What It Is," America/3 School Board Journal. March, 
1974b, 32-36. 

Roger Kaufman, "Accountability, A System Approach and the 
Quantitative Improvement of Education — An Attempted 
Integration," Educational Technology . January, 1971, 
21-26. 

C. Philip Kearney, David Donovan, and Thomas Fisher, "In 

•^Defense of Michigan's Accountability Program," Phi Delta 
J Kappan. September, 1974, 56(1): 14-19. 

Claudia Keller, "Criterion-Referenced Measurement: A 

Bibliography," ERIC Clearinghouse on Tests, January, 1972 

James Kemp, Accountability : Related Bibliographies . Florida 
Department of Education, "1974. 

Stephen Klein, "The Uses and Limitations of Standardized 
Tests in Meeting the Demands for Accountability," 
Evaluation Comment. January, 1971, 2: 1-7. 

, and Marvin C. Alkin, "Evaluating Teachers for Outcome 

Accountability," Evaluation Comment. May, 1972, 3: 5-11 

Richard Kraft, ed., strategies of Educational Planning. 

Educational Systems Development Center, Florida State 
University, 1969. 

David Krathwohl, Benjamin Bloom, B. B. Masia, Taxonomy of 

Educational Objectives , Handbook II: Affective Domain. 
David McKay, 1964. 

W. Stanley Kruger, "Accountability in DSPC Programs: Bureau 
of Elementary and Secondary Education," memorandum, 
U.* S. Office of Education, April 3, 1970. 

, "Program Auditor: New Breed on the Education Scene," 
American Education , March, 1970, 6: 36. 

60 

55 



Caroll Lang and Keith Rose, "Community Involvement in Edu- 
cational Accountability," Phi Delta Kappan. October, 

1972, 54: 80. 

Robert L. Leight, ed., Philosop.'iers Speak on Accountability 

in Education . Interstate Printers and Publishers, 1973. 

Sam Leles and Raymond Bernabei, writing and Using Behavioral 
Objectives . W. B. Drake and Son, 1969. 

Roger P. Lennon, "To Perform and To Account," Journal of 
Research and Development in Education. Fall, 1971, 
5: 3-14. 

Leon Lessinger, "Engineering Accountability for Results in 
Public Education," Phi Delta Kappan. Decenlber, 1970a, 
52: 217-225. 

, Every Kid A Winner : Accountability in Education » 

sTmon and ScHuster, '1970b. 

, "The Powerful Notion of Accountability in Education, 

Journal of Secondary Education . December, 1970c * 

, and Ralph Tyler, eds., Accountability in Education. 

Charles Jones, 3 971. 

Henry M. Levin, "A Conceptual Framework for Accountability 

in Education," School Review. May, 1974, 82: 363-7391. 

, "Vouchers and Social Equity," Change. 'October, 

1973, 29-33. 

Myron Lieberman, "An Overview of Accountability," Phi Delta 
Kappan. December, 1970, 52: 194-195. 

Erick Lindman, "Benefits and Costs of Education-" unpublishecl 
report to the California Advisory Council on Educational 
Research. Fall, 1970. 

Leslie Livingstone, "Integrating^the Hierarchies of Control," 
; in Contemporary Management: Issues and Viewpoints, ed. 
^by J. W. McGuire. Prentice-Hall, 1974, 534-539. ^ 

Felix M. Lopez, "Accountability in Education," Phi Delta Kapp 
December, 1970, 52: 231-235. 

Fremont Lyden and Ernest Miller, eds., Planning-Programming- 
Budgeting : A Systems Approach to J^anagemen t . Markham 
Publishing, 1968. ^ 

' 61 

56 



Robert Mager, Developing Attitudes Toward Learning. 
Publishers, 1968. 



Fearon 



, Prepar ing' Instructional Objectives . Fearon 



Publishers, 1962 • 



James G, March, ed 
1965. 



Handbook of Organizations. 



Rand McNally, 



, and Herbert Simon, Organizations . John Wiley, 1958, 

Joseph L. Mazur, "Operationalizi'ng Accountability in Public 
School Systems," Emerging Patterns of Administrative 
Accountability, ed. .by L. H. Browder. McCutchan 
Publishing, 1971, 511-523. 

Michigan Department of Education, A Position statement of 
Educational Accountabil ity Michigan Department of 
Education, 1972. 

William Milliken, "Making the School System Accountable," 
Compact. October, 1970, 4: 17-18. 

Jason Millman, "Reporting Student Progress: A Case for a « 
• Criterion- Referenced Marking System," Phi Delta Kappan. 
December, 1970, 5.2: 226-230- 

'Alfred Morin, "Handbook for Educational Program Audit," USOE 
Contract no. OEC-O-70-5047 , Alfred J. Morin Associates, 
June, 1971. 

Walter Myleciaine , , "The Charrette Process," in Education 

for' the People:' A Resource Book for School-Commvnity 

r Decision- Making . California Legislature, 1971, 
pp. 189-192. 

A. D. Nevnnan eind- R. W. Rowbottom, Organization Analysis. 
Southern Illinois University Press, 1968. 

New Rochelle Board of Education, The New Rochello School 
Profile, New Rochelle, New York, 1971. 

Fred Niedermeyer and Stephen Klein, "An Empirical Evaluatior 
of a District Teachers' Accountability Program, Phi 
DeJtra Kappar.. October, 1972, 54: 100-103. 

David Novick, ed. , Program Budgeting: Program Analysis and 
the Federal Budget. Harvard University Press, 1967. 

Ohio Department of Education, Ohio Accountability Project 



Reports . 




Talcott Earsons, et. al., ed-s., Theories of Society: 

Foundations of Modern Sociological Theory, The Free 
P)?ess, 1965. * 

David Payne, The Specification and Measureinent of Learning ^ 
^Outcome. Blaisdell Fablishing, 
« 

Russell Peterson, "Accountability as a Stare Function," 
Compact. October, 1970, 4: 19-20. 

Gene M. Pillot, "A Preliminary Proposal for System Account- 
ability," memorandum to the Board of Education, Sarasota* 
County, Florida, March 21, 1972. 

W.'* James Popham, criterion-Referenced Measurement. Edu- 
cational Technology, 19^1, 

, "Performance Tests of Teaching Proficiency: Rationale, 

Development, and Validation," American Educational Re- 
search Journal. January, 1971, 8(1): 105-117. 

{ 

Profiles of Achievement in the Tulsa Public Schools. Tulsa 
Board of Education, Oklahoma, 1970. 

John Rand and Michael Stover*>-^Field .Proven Model of System 
Planning and Educational Accountability," unpublished 
report, ^Temple , City Unified School District, California-) 
April, 19.71. 

Anatol Rapoport, ^"Mathematical Aspects of General Systems 

Analysis," General Systbms II. Yearbook of the Society 
for General Systems Research, 1966. 

Richard Rein, "Mass Testing Usually Gets for Controversy," 

New York Times. August 4, 1974, E9. 

E. Wayne Roberson, ed. , Educational Accountability Through 
Evaluation . Educational Technology, 1971. 

B. Keith Rose, et. al.. Educational Goals and Objectives: A 

Model Program for Community and Professional Involvement. 
Northern Calif ornia , Program Development Center^ 1971. 

Benjamin Rosner, The Power of Competency-Based Teacher Ed- 
ucation. Allyn and Bacon, 1972. 

^ , and Patricia Kay, "Will the Promise of C/PBTE Be 

Fulfilled?" Phi Delta Kappah. January, 1974, 55: 290-295. 

Creta Sabine, ed. , Accountability: Systems Planning in 
Education . ETC Publications, 1973. 

' 63 



58 



. \ 



San Juan Board of Cooperative Services, Painless Account- 
ability* Durango , Colorado ,1974. 

Allen A. Schmieder, Competency-Based Education: The State 
of the Scene. American Association of Colleges for 
Teacher Education, 197 3. - 

Frank Schmidtlein, "Decision ^Process Paradigms in Education, 
Educational Researcher. May, 1974, 3(5): 4-11. 

Frank Sciara and Richard Jantz, eds.. Accountability in 
American Education. Allyn and Bacon, 1970. 

Albert Shanker, "Performance ^Contraqting in District 9: A 

Bronx Cheer for 0E0,7 New York Times. January 2, 1972, 
E7. / ' - 

Herbert Simon, Administrative Behavior, 2d ed. Macmillan, 
1957a/ 

, Models of Man, Social and Rational. John Wiley, 



1957b. 

Garth Sorenson, "Evaluati'on for the Improvement of Instruct- 
ional Programs," Evaluation Comment. January, 1971, 
2: 13-18. 

Nancy Stark, "How Schools Can Listen to the Coitmiunity , " 
American Education. July, 1971, 10. 

A. Jackson Stenner and William Webster, Educational Program 
Audit Handbook.- Alabama State Department of Education 
May, 1971. 

Harry Summerfield, The Neighborhood-Based Politics of 
Education. Charles E. Merrill; 1971. 

J. Allan Thomas, The Productive School. John Wiley, 1971. 

James D. Thompson, Orgcinizations in Action. McGraw-Hill, 
1967. 

Robert Thompson, A systems Approach to instruction. Linnet 
Book, 1971. 

Michael Usdan, "Citizen Participation: Learning from New 
York City's Mistakes, Urban Review. September, i.oy, 
4: 9-12. 



G4 

59 



♦ 



Ralph Van Dusseldorp, Duane Richardson, and Walter Foley, 
^Educational Decision Making Through Operations 
Research, Allyn and Bacon, 1971* 

Sir Geoffrey Vickers, The Art of Judgment. Basic Books, 
1965. • ^ 

W. Timothy Weaver, "The Delphi Forecasting Method," Phi 
Delta Kappan. January, 1971, 52 : 267-272. 

Robert Williams, "Patterns of Influence Attempts in Decision 
Making Groups in the Educational Facilities Charrette," 
unpublished Ed.D. dissertation. School of Education, 
" ' Stanford University, 1970. 

Edwafrd Wynne, The Politics of School Accountability : Public 
i ^ Information about Public Schools . McCutchan Publishing, 

i972* ^ . ^ • 

Albert Yee, ed.. Perspectives on Management Systems Approache 
in Education . Educational Technology Publications, 1973 



G5 

60 



CAP PUBLICATIONS 



Report 
Number 



1 Annotated Bibliography of the State Educational Accountability Repository. 
Phyllis Hawthorne. Revised April 1974. Wisconsin.. ^ 

2 Legislation by the States: Accountability and Assessment in Education. Phyllis 
Hawthorne. Revised August 1974. Wisconsin. 

4 State Goals for. Elementary and Secondary Education. Susan Ketchum Ribble. 
Revised September 1973. Wisconsin. ERIC ED 083747; 

5 Characteristics of and Proposed Models for State Accountability Legislation. 
Phyllis Hawthorne and Archie A. Buchmiller. April 1973. Wi^onsin. ERIC ED 
078 514 , ' . / 

6 Accountability: A Bibliography. Gordon P. Hanson. July 1973. Wisconsin; 
ERIC ED 084630: . * 

» ^ 

2p Keeping the Public Inforrned: Accent on Accountability. A digest of the 
Michigan dissemination^ model. Erwin P^Bettinghaus and Gerald R. Miller. 
1973. Michigan. \ / , ' 



21 A Dissemination System for State Accountability Programs. Erwin P. 

Bettinghaus and Gerald R. Miller, June 1973. Michigan. ' 

/ 

22 ^Developing a Large sSle Assessnierjt Program. Frank B.-Wonier. July 1973, 
Minnesota. * , , ' 

23 rhdicatorsand Statewide Assessment. M^rc\\^Q^ A. Or^ot\. 

24 Roles of the Participants in Educational AccountabilitY. Carl E. Wilsey and 
Glenn B. Schroeder. 1974. Colorado: 

25 Using Educational Indicators fpr Program Accountability. Michael J, Grady, Jr, 
September 1974. Colorado.^ 



NOTE Documents with ERIC reference numbers can be obtained thrO^ugh the usual EBIC 
procedures , \ ^ 



p Copies rnay be obtained from: 



\ 



STATE EDUCATlONAll ACCOUNTABILITY REPOSITORY 
WISCONSIN DEPARTMENT OF PUBLIC INSTRUCTION 
126 LANGDON STREET 
IVlADlSOfJ, WISCONSIN 53702 . 

66; 



